-- Logs begin at Fri 2022-06-24 09:30:49 UTC, end at Fri 2022-06-24 10:38:11 UTC. -- Jun 24 10:07:30.739129 dv-cinder-847132-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 10:07:30.748379 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:07:30 2022] *** Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: nodename: dv-cinder-847132-2-iscsi Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: machine: x86_64 Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: clock source: unix Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: pcre jit disabled Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: detected number of CPU cores: 4 Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: current working directory: / Jun 24 10:07:30.750491 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: your processes number limit is 47680 Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: your memory page size is 4096 bytes Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: detected max file descriptor number: 2048 Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: lock engine: pthread robust mutexes Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: thunder lock: enabled Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 10:07:30.751267 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:07:30.793956 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: Python main interpreter initialized at 0x55e0fc2799c0 Jun 24 10:07:30.793956 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: python threads support enabled Jun 24 10:07:30.793956 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: your server socket listen backlog is limited to 100 connections Jun 24 10:07:30.793956 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:07:30.794297 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:07:30.794385 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: *** Operational MODE: preforking *** Jun 24 10:07:30.794613 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:07:30.794613 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: spawned uWSGI master process (pid: 103302) Jun 24 10:07:30.794837 dv-cinder-847132-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 10:07:30.797688 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: spawned uWSGI worker 1 (pid: 103303, cores: 1) Jun 24 10:07:30.797688 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: spawned uWSGI worker 2 (pid: 103304, cores: 1) Jun 24 10:07:30.797688 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:07:31.442803 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:07:31.443467 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:07:32.556664 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:07:32.556664 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: from cryptography.utils import int_from_bytes Jun 24 10:07:32.557323 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:07:32.557323 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: from cryptography.utils import int_from_bytes Jun 24 10:07:32.557438 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:07:32.557438 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: from cryptography.utils import int_from_bytes Jun 24 10:07:32.557813 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:07:32.557813 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: from cryptography.utils import int_from_bytes Jun 24 10:07:34.981738 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:07:34.982298 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:07:34.982657 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:07:34.982833 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:07:34.982919 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:07:34.982994 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:07:34.983059 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:07:34.983126 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:07:34.983190 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:07:34.983263 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:07:34.983357 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.983525 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.983660 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.983783 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.983998 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.984109 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.984332 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.984484 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.984650 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.984801 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.984933 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.985037 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.985276 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.985409 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.985589 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.985735 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.985915 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986059 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986147 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986234 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986468 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986617 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986781 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-2-iscsi {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.986914 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-2-iscsi {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.987128 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.987261 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.987432 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.987565 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.987741 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.987986 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.988139 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.988272 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.988398 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.988549 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.988713 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.988889 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.989014 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.989133 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.989532 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.989722 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.990844 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991016 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991161 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991308 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991437 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991556 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991687 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991802 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.991936 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992064 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992185 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992312 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992432 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992568 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992704 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992833 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.992954 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993074 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993204 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993339 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993461 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-2-iscsi {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993581 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-2-iscsi {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993713 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993845 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.993957 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.994090 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.994216 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.994337 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.994549 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.994798 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.994929 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995041 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995174 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995303 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995432 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995561 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995689 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995818 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.995940 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996068 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996188 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996308 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996464 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996606 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996815 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.996995 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.997153 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.997359 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.997504 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.997645 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.997777 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.997906 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998027 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998155 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998283 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998414 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998536 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998668 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998840 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.998962 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.999098 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.999221 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.999357 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.999487 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.999708 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:34.999901 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000053 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000179 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000302 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000428 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000558 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000701 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000828 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.000959 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001092 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001222 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001351 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001489 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001650 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001786 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.001951 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.002092 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.002231 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.002352 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.002563 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.002774 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.002913 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003038 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003179 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003303 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003435 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003624 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003816 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.003982 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004112 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004228 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004366 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004488 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004704 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004839 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.004973 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.005102 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.005270 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.005402 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.005692 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.005892 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.005892 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.006257 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.006382 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.006519 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.006519 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.006826 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.006963 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007088 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007208 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007319 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007457 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007586 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007710 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.007830 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008040 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008222 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008357 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008495 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008632 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008758 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.008889 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009011 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009244 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009422 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009555 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009678 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009800 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.009934 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.010068 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.010192 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.010314 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.010434 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.010639 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.010843 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011006 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011139 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011264 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011386 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011507 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011636 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011810 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.011942 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012132 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012328 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012463 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012599 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012723 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012843 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.012965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.013085 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.013295 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.013492 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.013627 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.013751 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.013883 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.014006 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.014128 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.014258 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.014462 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.014643 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.014925 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015056 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015164 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015292 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015402 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015508 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015653 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015791 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.015986 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016178 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016324 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016468 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016594 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016722 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016851 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.016982 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.017135 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.017271 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.017481 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.017659 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.017795 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.017932 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.018058 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.018180 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.018348 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.018479 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.018674 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.018904 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019031 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019187 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019313 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019442 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019651 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019760 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.019901 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.020107 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.020287 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.020437 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.020575 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.020702 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.020823 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021019 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021216 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021350 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021494 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021626 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021755 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.021882 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022005 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022162 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022305 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022464 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022596 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022788 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.022937 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023069 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023193 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023410 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023590 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023722 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023849 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.023984 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.024107 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.024314 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.024494 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.024641 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.024766 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.024917 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:07:35.025130 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.025258 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.025393 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.025514 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.025634 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.025880 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.026061 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.026192 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.026317 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.026508 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.026742 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.026895 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027024 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027159 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027288 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027410 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027531 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027732 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.027858 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028035 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028170 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028343 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028475 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028651 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028782 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.028959 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.029095 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.029274 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.029398 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.029589 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.029723 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.029905 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030028 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030221 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030353 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030536 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030659 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030869 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.030995 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.031176 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.031314 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.031492 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.031617 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.031809 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.031945 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.032120 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.032246 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.032426 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.032559 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.032767 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.032900 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.033082 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.033208 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.033403 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.033525 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.033719 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.033842 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.034035 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.034158 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.034341 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.034464 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.034648 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.034798 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.035010 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.035148 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.035339 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.035599 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.035726 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.035930 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036074 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036240 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036366 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036551 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036677 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036857 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.036981 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.037164 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.037299 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.037469 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.037594 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.037777 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.037903 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.038084 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.038209 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.038402 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.038525 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.038761 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.038892 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039048 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039171 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039358 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039495 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039673 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039798 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.039978 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.040112 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.040278 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.040411 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.040581 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.040706 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.040880 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041003 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041180 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041314 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041481 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041612 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041784 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.041908 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.042085 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.042290 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.042414 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.042533 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.042723 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.042852 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043032 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043169 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043338 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043463 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043647 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043772 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.043954 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044078 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044256 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044380 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044563 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044687 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044862 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.044992 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.045158 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.045282 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.045482 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.045608 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.045738 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.045862 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.046056 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.046182 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.046373 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.046497 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.046678 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.046824 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047015 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047139 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047314 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047450 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047615 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047739 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.047921 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048051 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048225 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048362 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048529 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048652 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048833 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.048956 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.049139 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.049279 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.049446 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.049569 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.049754 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.049877 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.050062 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.050188 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.050426 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.050692 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.050850 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.051157 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.051294 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.051474 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.051600 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.051780 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.051905 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.052092 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.052231 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.052397 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.052522 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.052705 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.052828 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053012 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053144 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053315 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053445 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053619 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053742 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.053922 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054053 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054227 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054351 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054528 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054650 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054854 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.054988 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.055158 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.055282 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.055533 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.055674 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.055809 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.055930 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056051 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056171 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056335 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056460 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056649 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056773 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.056951 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.057079 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.057252 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.057379 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.057593 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.057725 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.057897 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058022 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058215 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058346 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058526 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058651 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058867 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.058992 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.059176 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.059316 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.059484 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.059609 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.059790 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.059914 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.060098 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.060229 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.060408 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.060534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.060716 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.060845 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061023 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061160 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061328 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061466 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061637 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061760 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.061941 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.062065 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.062252 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.062374 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.062551 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.062674 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.062888 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063015 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063203 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063326 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063505 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063632 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063817 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.063951 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.064154 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.064285 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.064459 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.064581 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.064771 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.064897 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.065079 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.065203 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.065385 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.065518 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.065730 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.065858 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066005 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066136 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066316 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066448 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066620 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066843 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.066972 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.067093 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.067288 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.067427 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.067599 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.067725 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.067904 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068026 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068347 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068516 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068640 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.068965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.069145 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.069278 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.069448 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.069581 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.069765 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.069890 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.070071 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.070195 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.070391 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.070523 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.070718 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.070844 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071050 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071184 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071332 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071456 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071637 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071770 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.071945 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072071 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072254 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072391 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072562 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072686 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072867 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.072991 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.073174 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.073297 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.073474 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.073611 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.073782 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.073913 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.074092 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.074215 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.074395 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.074527 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.074694 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.074839 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075031 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075155 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075334 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075476 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075635 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075844 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.075970 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076092 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076249 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076389 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076548 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076671 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076852 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.076984 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.077167 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.077305 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.077470 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.077596 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.077769 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.077899 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078071 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078197 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078372 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078501 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078676 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078858 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.078991 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.079113 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.079291 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.079430 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.079615 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.079745 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.079928 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080052 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080232 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080356 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080541 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080663 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080849 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.080976 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.081154 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.081279 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.081462 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.081615 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.081820 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.081946 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.082126 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.082250 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.082438 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.082573 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.082772 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.082898 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083082 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083216 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083384 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083525 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083690 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083813 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.083999 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.084134 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.084306 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.084444 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.084612 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.084736 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.084913 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.085039 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.085218 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.085349 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.085525 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.085652 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.085894 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.086095 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.086229 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.086431 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.086554 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.086773 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.087024 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.087149 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.087364 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.087490 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.087681 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.087814 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088001 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088128 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088323 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088456 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088641 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088766 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.088972 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.089109 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.089286 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.089419 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.089593 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.089711 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.089898 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090033 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090210 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090340 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090514 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090637 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090842 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.090968 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.091146 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.091269 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.091447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.091572 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.091749 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.091871 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092048 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092180 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092351 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092474 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092648 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092771 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.092950 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093084 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093250 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093375 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093552 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093677 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093854 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.093987 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.094152 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.094274 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.094462 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.094586 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.094776 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.094986 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.095113 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.095243 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.095364 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.095492 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.095679 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.095804 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096009 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096150 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096273 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096399 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096601 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096727 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.096906 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.097032 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.097281 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.097408 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.097676 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.097810 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.097932 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098052 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098195 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098330 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098501 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098625 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098826 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.098952 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.099138 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.099278 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.099439 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.099564 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.099738 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.099856 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100043 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100177 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100347 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100471 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100645 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100768 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.100951 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101086 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101254 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101384 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101559 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101681 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101857 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.101984 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.102156 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.102279 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.102461 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.102585 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.102771 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.102895 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.103070 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.103195 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.103374 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.103506 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.103674 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.104153 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.104338 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.104523 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.104651 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.104772 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.104932 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105059 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105248 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105372 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105548 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105689 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105846 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.105969 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.106142 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.106277 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.106455 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.106600 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.106768 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.106893 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107071 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107193 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107367 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107508 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107671 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107873 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.107998 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108118 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108259 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108399 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108566 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108690 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108865 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.108990 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.109168 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.109294 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.109475 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.109599 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.109793 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.109919 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.110093 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.110226 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.110397 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.110528 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.110743 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.110886 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111023 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111145 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111316 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111443 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111746 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.111925 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.112056 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.112230 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.112359 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.112532 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.112674 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.112850 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.115321 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.115321 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.115578 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.115700 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.115831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.115953 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116075 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116194 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116314 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116441 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116572 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116693 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116814 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.116933 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117053 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117174 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117303 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117425 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117546 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117665 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.117786 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118005 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118132 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118254 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118374 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118493 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118603 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118758 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.118951 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.119159 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.119355 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.119548 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.119759 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.119968 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.120166 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.120359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.120552 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.120688 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.120810 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121016 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121189 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121314 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121435 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121554 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121676 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121806 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.121928 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122048 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122175 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122297 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122428 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122549 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122669 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122809 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.122930 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123049 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123188 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123314 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123444 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123565 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123693 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123815 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.123972 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124096 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124217 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124337 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124458 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124579 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124784 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.124909 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125037 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125158 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125277 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125407 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125529 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125649 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125776 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.125897 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126027 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126157 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126286 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126408 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126530 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126657 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126817 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.126953 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127075 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127196 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127316 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127435 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127556 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127686 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127808 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.127928 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.128129 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.128129 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.128384 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.128384 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.128749 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.128749 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129104 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129104 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129356 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129479 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129608 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129731 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129853 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.129972 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130110 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130232 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130354 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130474 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130594 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130740 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.130884 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131007 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131135 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131257 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131378 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131507 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131628 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131749 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131870 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.131990 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132119 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132370 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132498 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132620 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132740 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132862 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.132991 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133112 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133218 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133322 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133449 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133578 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133708 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133830 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.133951 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.134071 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.134259 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.134394 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.134565 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.134691 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.134896 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135027 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135217 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135361 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135522 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135656 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135845 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.135979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.136272 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.136436 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.136560 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.136687 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.136865 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.136998 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.137210 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.137343 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.137528 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.137654 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.137849 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.137974 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.138187 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.138319 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.138440 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.138559 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.138767 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.138911 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.139090 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.139217 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.139399 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.139525 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.139704 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.139828 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140020 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140145 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140323 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140449 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140771 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.140949 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.141074 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.141255 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.141380 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.141571 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.141695 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.141889 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.142013 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.142200 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.142328 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.142519 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.142644 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.142912 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143047 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143238 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143365 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143543 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143669 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143846 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.143984 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.144376 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.144513 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.144628 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.144750 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.144872 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145012 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145134 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145255 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145376 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145548 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145674 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145856 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.145990 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.146165 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.146291 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.146472 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.146610 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.146798 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.146944 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.147101 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.147235 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.147423 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.147559 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.147724 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.147850 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148043 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148180 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148375 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148516 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148641 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148752 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.148965 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.149098 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.149268 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.149402 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.149586 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.149711 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.149890 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150014 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150191 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150316 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150492 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150626 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150815 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.150950 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.151119 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.151245 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.151420 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.151546 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.151751 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.151884 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.152052 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.152184 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.152373 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.152506 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.152687 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.152818 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153014 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153139 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153323 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153456 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153642 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153775 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.153958 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.154085 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.154276 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.154407 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.154577 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.154757 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.154884 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155018 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155196 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155321 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155498 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155636 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155798 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.155923 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156100 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156223 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156452 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156586 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156709 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156830 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.156961 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157083 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157259 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157386 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157560 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157685 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157861 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.157987 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.158180 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.158311 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.158514 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.158638 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.158791 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.158914 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.159086 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.159221 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.159385 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.159510 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.159704 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.159851 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.160206 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.160332 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.160539 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.160678 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.160840 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.160978 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.161168 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.161293 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.161482 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.161614 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.161793 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.161964 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.162117 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.162243 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.162427 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.162559 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.162765 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.162908 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.163084 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.163300 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.163431 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.163552 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.163695 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.163834 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164007 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164130 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164326 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164450 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164634 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164758 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.164945 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.165078 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.165256 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.165382 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.165634 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.165768 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.165890 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.166195 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.166379 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.166520 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.166771 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.166904 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.167099 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.167224 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.167415 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.167540 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.167729 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.167855 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168042 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168166 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168348 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168499 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168694 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168817 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.168937 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169051 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169246 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169450 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169583 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169711 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169831 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.169951 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.170163 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.170295 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.170483 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.170602 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.170827 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.170964 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.171143 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.171266 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.171455 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.171579 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.171764 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.171886 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.172076 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.172201 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.172388 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.172511 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.172712 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.172849 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173025 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173148 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173335 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173457 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173645 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173777 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.173955 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.174086 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.174267 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.174389 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.174577 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.174721 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.174911 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.175034 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.175223 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.175357 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.175918 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176107 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176239 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176491 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176611 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176808 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.176940 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177061 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177181 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177309 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177439 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177561 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177685 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177812 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.177941 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.178062 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.178191 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.178311 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.178558 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.178696 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.178961 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.179116 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.179295 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.179420 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.179621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.179745 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.179943 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.180069 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.180262 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.180393 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.180579 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.180710 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.180905 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181037 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181211 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181335 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181514 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181638 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181827 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.181960 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.182136 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.182263 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.182440 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.182564 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.182762 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.182903 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.183083 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.183208 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.183387 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.183511 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.183686 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.183821 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.184002 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.184164 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.184293 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.184539 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.184829 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.184955 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.185182 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.185308 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.185501 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.185633 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.185822 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.185944 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.186139 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.186263 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.186446 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.186569 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.186776 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.186902 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.187090 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.187223 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.187395 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.187519 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.187698 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.187821 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188005 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188126 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188308 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188451 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188609 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188733 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.188914 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189038 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189220 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189351 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189522 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189654 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189823 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.189944 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.190121 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.190256 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.190420 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.190544 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.190759 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.190883 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.191207 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.191813 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.191947 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192071 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192199 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192199 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192439 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192563 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192685 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192805 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.192924 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193055 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193184 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193304 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193424 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193543 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193673 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193793 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.193926 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194048 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194167 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194335 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194458 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194643 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194816 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.194972 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.195095 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.195280 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.195401 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.195629 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.195754 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.195947 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196069 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196250 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196372 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196550 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196681 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196864 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.196987 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.197173 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.197296 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.197493 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.197623 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.197804 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.197934 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.198114 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.198236 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.198458 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.198582 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.198798 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.198925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.199329 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.199463 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.199661 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.199784 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.199982 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.200104 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.200311 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.200442 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.200639 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.200761 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.200942 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201063 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201244 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201375 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201545 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201666 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201866 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.201988 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.202176 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.202311 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.202486 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.202610 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.202819 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.202943 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.203131 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.203255 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.203439 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.203570 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.203749 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.203872 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204054 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204178 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204363 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204486 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204670 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204799 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.204976 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.205100 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.205281 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.205403 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.205587 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.205789 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.205912 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.206030 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.206188 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.206321 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.206526 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.206662 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.207181 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.207318 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.207441 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.207569 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.207691 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.207820 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208035 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208176 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208306 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208427 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208561 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208690 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208811 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.208931 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209050 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209172 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209300 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209413 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209585 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209712 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.209896 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.210020 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.210197 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.210329 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.210616 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.210753 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.210969 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.211063 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.211290 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.211376 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.211608 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.211699 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.211917 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212011 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212234 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212318 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212550 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212634 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212856 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.212950 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.213175 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.213271 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.213483 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.213567 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.213809 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.213901 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.214148 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.214231 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.214473 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.214556 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.214824 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.214931 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.215129 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.215214 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.215431 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.215523 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.215731 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.215816 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216036 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216119 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216351 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216453 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216657 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216744 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.216957 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217048 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217256 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217351 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217564 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217648 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217862 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.217946 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.218160 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.218252 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.218460 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.218542 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.218785 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.218874 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219093 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219191 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219393 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219475 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219691 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219776 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.219991 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220077 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220287 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220371 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220585 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220668 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220883 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.220968 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.221189 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.221274 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.221488 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.221571 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.221785 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.221870 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.222082 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.222166 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.222531 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.222630 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.222820 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.222914 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.223087 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.223172 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.223417 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.223516 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.223738 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.223832 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224059 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224145 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224369 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224462 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224688 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224780 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.224995 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.225080 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.225311 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.225405 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.225629 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.225721 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.225939 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226025 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226244 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226337 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226573 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226656 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226906 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.226992 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.227216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.227302 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.227523 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.227608 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.227829 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.227922 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.228135 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.228227 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.228445 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.228536 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.229124 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.229213 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.229451 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.229551 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.229757 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.229882 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.230078 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.230209 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.230396 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.230528 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.230757 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.230884 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231053 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231190 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231363 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231486 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231688 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231857 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.231998 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.232128 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.232288 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.232420 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.232601 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.232734 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.232908 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233040 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233214 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233343 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233527 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233657 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233842 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.233965 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.234166 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.234289 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.234492 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.234617 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.234836 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.234961 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.235142 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.235267 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.235468 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.235599 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.235816 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.235946 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.236127 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.236248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.236471 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.236608 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.236795 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.236917 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.237108 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.237231 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.237416 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.237546 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.237720 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.237868 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:07:35.238138 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103304) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:07:35.238639 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103303) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:07:35.393810 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO dbcounter [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Registered counter for database nova_api Jun 24 10:07:35.395168 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Registered counter for database nova_api Jun 24 10:07:35.415250 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.417033 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.422366 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writer thread running {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.423504 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.480227 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.context [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c7d15be-2aaf-4832-94f4-0ad39b6d90ec(cell1) {{(pid=103303) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:07:35.480769 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.context [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c7d15be-2aaf-4832-94f4-0ad39b6d90ec(cell1) {{(pid=103304) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:07:35.484388 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:35.484813 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:35.485933 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.486424 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.486745 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:35.487269 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:07:35.488940 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.489327 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_concurrency.lockutils [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103304) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:07:35.491045 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO dbcounter [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Registered counter for database nova_cell0 Jun 24 10:07:35.491414 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Registered counter for database nova_cell0 Jun 24 10:07:35.495275 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO dbcounter [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Registered counter for database nova_cell1 Jun 24 10:07:35.495677 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Registered counter for database nova_cell1 Jun 24 10:07:35.503387 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.505270 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.508536 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writer thread running {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.509328 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.513986 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.515493 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.643809 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.649646 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writer thread running {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.659022 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO dbcounter [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Registered counter for database nova_cell0 Jun 24 10:07:35.659459 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO dbcounter [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Registered counter for database nova_cell0 Jun 24 10:07:35.670105 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_db.sqlalchemy.engines [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103303) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.673769 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG oslo_db.sqlalchemy.engines [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103304) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:07:35.674639 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writer thread running {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:35.679134 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writer thread running {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:07:36.011905 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: WARNING keystonemiddleware.auth_token [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:07:36.014030 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:07:36.019202 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: WARNING keystonemiddleware.auth_token [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:07:36.021510 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:07:36.359751 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: WARNING keystonemiddleware.auth_token [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:07:36.365719 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: WARNING keystonemiddleware.auth_token [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:07:36.370197 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:07:36.371049 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0fc2799c0 pid: 103303 (default app) Jun 24 10:07:36.373134 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:07:36.374338 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001759 Jun 24 10:07:36.374758 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Fri Jun 24 10:07:36 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:07:36.376080 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: WARNING keystonemiddleware.auth_token [None req-ff92e908-7544-4398-ac2d-763901b61964 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:07:36.381532 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e0fc2799c0 pid: 103304 (default app) Jun 24 10:08:52.062392 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:52.063423 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 24 10:08:52.063826 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 2/2] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:08:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:08:52.076439 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_api:SELECT=3 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:52.077582 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_cell0:SELECT=3 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:52.078297 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_cell1:SELECT=3 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:52.079529 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:52.545495 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-4bfd4f83-89d1-4cbd-b6e3-90c5c8af40fd admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:52.576549 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-4bfd4f83-89d1-4cbd-b6e3-90c5c8af40fd admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.505202 Jun 24 10:08:52.577160 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 1/3] 10.222.0.64 () {60 vars in 1291 bytes} [Fri Jun 24 10:08:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:54.625200 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:54.626695 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-e5d8830e-c53b-43ad-86b4-9c776a84ed68 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001916 Jun 24 10:08:54.627276 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 3/4] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:08:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:08:54.688064 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-7d172520-616d-4138-a1fd-25aec453b1c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "ram": 256, "rxtx_factor": 1.0, "disk": 1, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:54.706593 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:08:54.706593 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: warnings.warn(msg) Jun 24 10:08:54.741284 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-7d172520-616d-4138-a1fd-25aec453b1c4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106600 Jun 24 10:08:54.742128 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 2/5] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:08:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:08:54.986863 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-98ae88dd-52c0-4aec-bfe7-848d2dcf1bbe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:54.989440 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:08:54.989440 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: warnings.warn(msg) Jun 24 10:08:55.005628 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_api:SELECT=3 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:55.005628 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_cell1:SELECT=3 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:55.006255 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_cell0:SELECT=3 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:55.007069 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:08:55.057340 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-98ae88dd-52c0-4aec-bfe7-848d2dcf1bbe admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.307319 Jun 24 10:08:55.058154 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 4/6] 10.222.0.64 () {64 vars in 1335 bytes} [Fri Jun 24 10:08:54 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:57.156858 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-7d172520-616d-4138-a1fd-25aec453b1c4 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:57.157942 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-7d172520-616d-4138-a1fd-25aec453b1c4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Jun 24 10:08:57.158351 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 3/7] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:08:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:08:57.266428 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-3a91e207-3a8f-40c7-872b-51995c1fb939 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "swap": 0, "disk": 5, "id": "d1", "os-flavor-access:is_public": true, "ram": 512, "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:57.284049 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:08:57.284049 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: warnings.warn(msg) Jun 24 10:08:57.306063 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-3a91e207-3a8f-40c7-872b-51995c1fb939 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.141342 Jun 24 10:08:57.306629 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 5/8] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:08:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:08:57.319089 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-1235fb4d-5e65-43c6-bb53-19b1984683a2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:57.320596 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:08:57.320596 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: warnings.warn(msg) Jun 24 10:08:57.356224 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-1235fb4d-5e65-43c6-bb53-19b1984683a2 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041289 Jun 24 10:08:57.356834 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 4/9] 10.222.0.64 () {64 vars in 1335 bytes} [Fri Jun 24 10:08:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:08:59.477286 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-3a91e207-3a8f-40c7-872b-51995c1fb939 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:08:59.478319 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-3a91e207-3a8f-40c7-872b-51995c1fb939 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jun 24 10:08:59.479337 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 6/10] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:08:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:08:59.539189 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-26ffa85e-f8c1-455a-b7bf-e97047a84c2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "swap": 0, "disk": 10, "name": "ds1G", "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:59.558926 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-26ffa85e-f8c1-455a-b7bf-e97047a84c2e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074038 Jun 24 10:08:59.562747 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 5/11] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:08:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 24 10:08:59.572375 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-42fad120-aeec-4958-aafe-794cd31d30ee admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:08:59.600880 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-42fad120-aeec-4958-aafe-794cd31d30ee admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031569 Jun 24 10:08:59.602850 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 7/12] 10.222.0.64 () {64 vars in 1335 bytes} [Fri Jun 24 10:08:59 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:01.763689 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-26ffa85e-f8c1-455a-b7bf-e97047a84c2e admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:01.764705 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-26ffa85e-f8c1-455a-b7bf-e97047a84c2e admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Jun 24 10:09:01.765296 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 6/13] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:01.826214 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-1631e0ad-0bf5-4e1e-84b7-0e53c10022b1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:01.844522 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-1631e0ad-0bf5-4e1e-84b7-0e53c10022b1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073457 Jun 24 10:09:01.845063 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 8/14] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:01.857771 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-179271f3-35d6-477b-8c66-2e6f2409fba8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:01.883550 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-179271f3-35d6-477b-8c66-2e6f2409fba8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029891 Jun 24 10:09:01.884203 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 7/15] 10.222.0.64 () {64 vars in 1335 bytes} [Fri Jun 24 10:09:01 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:03.943037 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-1631e0ad-0bf5-4e1e-84b7-0e53c10022b1 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:03.944058 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-1631e0ad-0bf5-4e1e-84b7-0e53c10022b1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 24 10:09:03.944627 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 9/16] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:04.002726 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-d14019d6-6ed9-44af-b30d-4c9f5606d3d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "ds4G", "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "ram": 4096, "disk": 20, "vcpus": 4}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:04.021639 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-d14019d6-6ed9-44af-b30d-4c9f5606d3d1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071476 Jun 24 10:09:04.022228 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 8/17] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:04.034340 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-7411e471-42ea-401a-ad44-a4f065b4a2ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:04.065179 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-7411e471-42ea-401a-ad44-a4f065b4a2ec admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034640 Jun 24 10:09:04.065741 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 10/18] 10.222.0.64 () {64 vars in 1335 bytes} [Fri Jun 24 10:09:04 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:06.140877 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-d14019d6-6ed9-44af-b30d-4c9f5606d3d1 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:06.141883 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-d14019d6-6ed9-44af-b30d-4c9f5606d3d1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jun 24 10:09:06.142307 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 9/19] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:06.206140 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-fdde77df-ac0e-4240-b525-c6e99f32a37a admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:06.230815 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-fdde77df-ac0e-4240-b525-c6e99f32a37a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081645 Jun 24 10:09:06.238771 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 11/20] 10.222.0.64 () {60 vars in 1291 bytes} [Fri Jun 24 10:09:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:08.322658 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-d14019d6-6ed9-44af-b30d-4c9f5606d3d1 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:08.323765 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-d14019d6-6ed9-44af-b30d-4c9f5606d3d1 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jun 24 10:09:08.324190 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 10/21] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:08.387243 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-226beef3-f947-40dc-9a09-8e4fdafa3122 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "id": "1", "swap": 0, "os-flavor-access:is_public": true, "disk": 1, "vcpus": 1, "ram": 512, "rxtx_factor": 1.0}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:08.405843 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-226beef3-f947-40dc-9a09-8e4fdafa3122 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075608 Jun 24 10:09:08.406421 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 12/22] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:08 2022] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:08.419113 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-68e64a04-e96e-4e28-b644-599f42cab2d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:08.443006 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-68e64a04-e96e-4e28-b644-599f42cab2d8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028313 Jun 24 10:09:08.443633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 11/23] 10.222.0.64 () {64 vars in 1332 bytes} [Fri Jun 24 10:09:08 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:10.655035 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-226beef3-f947-40dc-9a09-8e4fdafa3122 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:10.656199 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-226beef3-f947-40dc-9a09-8e4fdafa3122 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001795 Jun 24 10:09:10.656721 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 13/24] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:09:10.726538 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a0bfc466-3288-47e3-ba0f-9e4030c03664 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 20, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small", "id": "2", "swap": 0}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:10.746395 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a0bfc466-3288-47e3-ba0f-9e4030c03664 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082363 Jun 24 10:09:10.747006 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 12/25] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:10.759598 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-4b4191f2-7a4c-410d-8f8a-7f9a5231611c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:10.787898 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-4b4191f2-7a4c-410d-8f8a-7f9a5231611c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032124 Jun 24 10:09:10.788737 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 14/26] 10.222.0.64 () {64 vars in 1332 bytes} [Fri Jun 24 10:09:10 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:13.371378 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a0bfc466-3288-47e3-ba0f-9e4030c03664 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:13.372476 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a0bfc466-3288-47e3-ba0f-9e4030c03664 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Jun 24 10:09:13.372903 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 13/27] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:13.437432 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-078c13d3-b76d-4658-b418-a18e5578567a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "swap": 0}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:13.457539 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-078c13d3-b76d-4658-b418-a18e5578567a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.078280 Jun 24 10:09:13.458141 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 15/28] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:13.470754 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-2f40826c-effb-4567-9fbf-82991e1a64fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:13.495517 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-2f40826c-effb-4567-9fbf-82991e1a64fc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028695 Jun 24 10:09:13.496154 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 14/29] 10.222.0.64 () {64 vars in 1332 bytes} [Fri Jun 24 10:09:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:09:15.568773 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-078c13d3-b76d-4658-b418-a18e5578567a admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:15.569787 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-078c13d3-b76d-4658-b418-a18e5578567a admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Jun 24 10:09:15.570342 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 16/30] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:15.633099 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3cc8219e-176b-42fc-b4f0-66e846c3e6a8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "swap": 0, "ram": 8192, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:15.652494 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-3cc8219e-176b-42fc-b4f0-66e846c3e6a8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.076447 Jun 24 10:09:15.653053 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 15/31] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:15.665376 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-9ac75a2d-6d80-4068-a5c7-17a9224b8edb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:15.689896 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-9ac75a2d-6d80-4068-a5c7-17a9224b8edb admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028251 Jun 24 10:09:15.690889 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 17/32] 10.222.0.64 () {64 vars in 1332 bytes} [Fri Jun 24 10:09:15 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:17.785265 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-3cc8219e-176b-42fc-b4f0-66e846c3e6a8 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:17.787006 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-3cc8219e-176b-42fc-b4f0-66e846c3e6a8 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002534 Jun 24 10:09:17.787578 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 16/33] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:17.851222 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-dfe90bb5-be5f-4f63-bab8-49a68ea9e7d4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "vcpus": 8, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "ram": 16384, "disk": 160, "name": "m1.xlarge", "swap": 0}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:17.874368 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-dfe90bb5-be5f-4f63-bab8-49a68ea9e7d4 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.080670 Jun 24 10:09:17.875486 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 18/34] 10.222.0.64 () {64 vars in 1282 bytes} [Fri Jun 24 10:09:17 2022] POST /compute/v2.1/flavors => generated 408 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:17.888227 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f346146e-81d0-46da-a969-f42fb2c9630c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:17.914802 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f346146e-81d0-46da-a969-f42fb2c9630c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030513 Jun 24 10:09:17.915656 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 17/35] 10.222.0.64 () {64 vars in 1332 bytes} [Fri Jun 24 10:09:17 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:09:42.055609 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-dfe90bb5-be5f-4f63-bab8-49a68ea9e7d4 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:42.056962 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-dfe90bb5-be5f-4f63-bab8-49a68ea9e7d4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001992 Jun 24 10:09:42.057517 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 19/36] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:09:42 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:42.071364 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:42.121295 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-4693fba6-24a3-46c9-a203-d73c984ec649 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:42.138818 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-4693fba6-24a3-46c9-a203-d73c984ec649 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072030 Jun 24 10:09:42.139341 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 18/37] 10.222.0.64 () {60 vars in 1291 bytes} [Fri Jun 24 10:09:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:09:43.084788 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-dfe90bb5-be5f-4f63-bab8-49a68ea9e7d4 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:43.085791 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-dfe90bb5-be5f-4f63-bab8-49a68ea9e7d4 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Jun 24 10:09:43.086183 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 20/38] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:43.293257 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-b51796b7-185f-481a-92d2-6ea932d1a972 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:43.299254 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.wsgi [None req-b51796b7-185f-481a-92d2-6ea932d1a972 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-b51796b7-185f-481a-92d2-6ea932d1a972 admin admin] Request method failure captured: Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Accept: application/json Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Accept-Encoding: gzip, deflate Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Connection: keep-alive Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Content-Length: 0 Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Host: 10.222.0.64 Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Openstack-Api-Version: compute 2.90 Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Openstack-System-Scope: None Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: User-Agent: python-novaclient Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Auth-Token: gAAAAABitY1nlVMDxo-NTN8AQnUzmJSQuW0M-C0f5HQBZaZOldoNhuNP-ZyuKXWR_QwPpVML7syrpgBHC5BvwqrzbpMReOak_Nc9rYhIAHYFth9Vc8gEGKf8SaqGo_vEc0dNOuuxybKtOf-nvr6-HQ2UZ85Imteq79oBbAVAKUfAXRbmJWBaSIE Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Domain-Id: None Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Domain-Name: None Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Identity-Status: Confirmed Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Is-Admin-Project: True Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Id: default Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Name: Default Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Name: admin Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Role: member,admin,reader Jun 24 10:09:43.302631 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Roles: member,admin,reader Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_98caa12ca1b14e52b73e3cce22837778", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}] Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant: admin Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant-Name: admin Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User: admin Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Id: default Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Name: Default Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Id: 68ba5f09c78c41f18a7e1c6789016a58 Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Name: admin Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: method: > Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: exception: Flavor 42 could not be found. Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: action_args: {'id': '42'} Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:43.304359 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:43.305633 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.307124 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-b51796b7-185f-481a-92d2-6ea932d1a972 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:43.308377 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-b51796b7-185f-481a-92d2-6ea932d1a972 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.078438 Jun 24 10:09:43.308377 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 19/39] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Jun 24 10:09:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:09:43.316558 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-ad236d80-1052-48f2-8a52-80e8294dd03d admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:43.320690 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:09:43.344501 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-ad236d80-1052-48f2-8a52-80e8294dd03d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033905 Jun 24 10:09:43.345062 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 21/40] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Jun 24 10:09:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:09:43.355887 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-6e1c46f0-2a63-4f0b-b890-ee7b5aae3982 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:43.378781 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-6e1c46f0-2a63-4f0b-b890-ee7b5aae3982 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026942 Jun 24 10:09:43.379281 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 20/41] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Jun 24 10:09:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:43.388889 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-df42a758-42cf-47ea-a2d5-6c14dfe0cf9f admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:43.395982 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.wsgi [None req-df42a758-42cf-47ea-a2d5-6c14dfe0cf9f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-df42a758-42cf-47ea-a2d5-6c14dfe0cf9f admin admin] Request method failure captured: Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Accept: application/json Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Accept-Encoding: gzip, deflate Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Connection: keep-alive Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Content-Length: 0 Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Host: 10.222.0.64 Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Openstack-Api-Version: compute 2.90 Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Openstack-System-Scope: None Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: User-Agent: python-novaclient Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Auth-Token: gAAAAABitY1nlVMDxo-NTN8AQnUzmJSQuW0M-C0f5HQBZaZOldoNhuNP-ZyuKXWR_QwPpVML7syrpgBHC5BvwqrzbpMReOak_Nc9rYhIAHYFth9Vc8gEGKf8SaqGo_vEc0dNOuuxybKtOf-nvr6-HQ2UZ85Imteq79oBbAVAKUfAXRbmJWBaSIE Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Domain-Id: None Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Domain-Name: None Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Identity-Status: Confirmed Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Is-Admin-Project: True Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Domain-Id: default Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Domain-Name: Default Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Name: admin Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Role: member,admin,reader Jun 24 10:09:43.402016 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Roles: member,admin,reader Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_98caa12ca1b14e52b73e3cce22837778", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}] Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant: admin Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant-Name: admin Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User: admin Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Domain-Id: default Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Domain-Name: Default Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Id: 68ba5f09c78c41f18a7e1c6789016a58 Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Name: admin Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: method: > Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: exception: Flavor 42 could not be found. Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: action_args: {'id': '42'} Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:43.403534 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:43.404621 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:43.405979 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-df42a758-42cf-47ea-a2d5-6c14dfe0cf9f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:43.407594 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-df42a758-42cf-47ea-a2d5-6c14dfe0cf9f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.018176 Jun 24 10:09:43.407594 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 22/42] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Jun 24 10:09:43 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:09:44.215952 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-6e1c46f0-2a63-4f0b-b890-ee7b5aae3982 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:44.216993 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-6e1c46f0-2a63-4f0b-b890-ee7b5aae3982 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Jun 24 10:09:44.217389 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 21/43] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:44.420230 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-ad76f490-8e50-4fb1-9fa6-d80ed547cfb1 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:44.427408 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.wsgi [None req-ad76f490-8e50-4fb1-9fa6-d80ed547cfb1 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-ad76f490-8e50-4fb1-9fa6-d80ed547cfb1 admin admin] Request method failure captured: Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Accept: application/json Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Accept-Encoding: gzip, deflate Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Connection: keep-alive Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Content-Length: 0 Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Host: 10.222.0.64 Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Openstack-Api-Version: compute 2.90 Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Openstack-System-Scope: None Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: User-Agent: python-novaclient Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Auth-Token: gAAAAABitY1oZZzINOnm6LR7Ubholp6RliXE5r-CK93LSKf7uoGwrjee4nDUvUvT5SdfgJvtKyjp8pGyHCELPk67Z-0MN7iDVArHpZYvO3MonlBaiW5y6uGEIdI1fvEr7hsD5RmOyhbZCje-9mJC4AKSIi6DEQihqV4Y6edeVq_x6JySiNvyzJk Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Domain-Id: None Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Domain-Name: None Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Identity-Status: Confirmed Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Is-Admin-Project: True Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Domain-Id: default Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Domain-Name: Default Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Name: admin Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Role: member,admin,reader Jun 24 10:09:44.428949 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Roles: member,admin,reader Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_98caa12ca1b14e52b73e3cce22837778", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}] Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant: admin Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant-Name: admin Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User: admin Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Domain-Id: default Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Domain-Name: Default Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Id: 68ba5f09c78c41f18a7e1c6789016a58 Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Name: admin Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: method: > Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: exception: Flavor 84 could not be found. Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: action_args: {'id': '84'} Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:44.430416 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:44.432576 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.433925 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-ad76f490-8e50-4fb1-9fa6-d80ed547cfb1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:44.435021 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-ad76f490-8e50-4fb1-9fa6-d80ed547cfb1 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.076727 Jun 24 10:09:44.435021 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Jun 24 10:09:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:09:44.440271 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-2f44a1cd-89a0-4065-a282-d7c2958ea5fc admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:44.454173 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-2f44a1cd-89a0-4065-a282-d7c2958ea5fc admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017581 Jun 24 10:09:44.454725 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 22/45] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Jun 24 10:09:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:44.466946 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-f6f3c2e7-7dbe-42cb-85af-8de585be6057 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:44.484437 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-f6f3c2e7-7dbe-42cb-85af-8de585be6057 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.023596 Jun 24 10:09:44.484970 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 24/46] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Jun 24 10:09:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:09:44.494735 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f7ae00dd-7c91-4752-b93d-22b0e0fa2a7a admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:44.500440 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.wsgi [None req-f7ae00dd-7c91-4752-b93d-22b0e0fa2a7a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f7ae00dd-7c91-4752-b93d-22b0e0fa2a7a admin admin] Request method failure captured: Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Accept: application/json Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Accept-Encoding: gzip, deflate Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Connection: keep-alive Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Content-Length: 0 Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Host: 10.222.0.64 Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Openstack-Api-Version: compute 2.90 Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Openstack-System-Scope: None Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: User-Agent: python-novaclient Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Auth-Token: gAAAAABitY1oZZzINOnm6LR7Ubholp6RliXE5r-CK93LSKf7uoGwrjee4nDUvUvT5SdfgJvtKyjp8pGyHCELPk67Z-0MN7iDVArHpZYvO3MonlBaiW5y6uGEIdI1fvEr7hsD5RmOyhbZCje-9mJC4AKSIi6DEQihqV4Y6edeVq_x6JySiNvyzJk Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Domain-Id: None Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Domain-Name: None Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Identity-Status: Confirmed Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Is-Admin-Project: True Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Id: default Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Name: Default Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Name: admin Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Role: member,admin,reader Jun 24 10:09:44.501965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Roles: member,admin,reader Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_98caa12ca1b14e52b73e3cce22837778", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}] Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant: admin Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant-Name: admin Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User: admin Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Id: default Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Name: Default Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Id: 68ba5f09c78c41f18a7e1c6789016a58 Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Name: admin Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: method: > Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: exception: Flavor 84 could not be found. Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: action_args: {'id': '84'} Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:44.503447 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:44.504216 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:44.505248 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-f7ae00dd-7c91-4752-b93d-22b0e0fa2a7a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:44.506257 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-f7ae00dd-7c91-4752-b93d-22b0e0fa2a7a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012236 Jun 24 10:09:44.506257 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 23/47] 10.222.0.64 () {60 vars in 1190 bytes} [Fri Jun 24 10:09:44 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:09:45.324569 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-f6f3c2e7-7dbe-42cb-85af-8de585be6057 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:45.325571 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-f6f3c2e7-7dbe-42cb-85af-8de585be6057 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 24 10:09:45.325980 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 25/48] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:45.534148 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-469d3e06-c9ed-44b1-b78c-8a31448e09aa admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:45.540869 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.wsgi [None req-469d3e06-c9ed-44b1-b78c-8a31448e09aa admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-469d3e06-c9ed-44b1-b78c-8a31448e09aa admin admin] Request method failure captured: Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Accept: application/json Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Accept-Encoding: gzip, deflate Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Connection: keep-alive Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Content-Length: 0 Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Host: 10.222.0.64 Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Openstack-Api-Version: compute 2.90 Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Openstack-System-Scope: None Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: User-Agent: python-novaclient Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Auth-Token: gAAAAABitY1prN9_788ulAqfG7ezlhy7p8L3CdOuOYBtHYjt85Oz1Olu5440QaDONFH3dkhT1YOOvagwa5Pve5h0lkZ02H1ns89ys-64Nl1L1Z0mBN8MaMf0Ac2Byjfj9yf3dTXxNKL8LYRg45taTqlvbQ_CjbAKFo30Qlue-ZaRRMmmD-yh1lA Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Domain-Id: None Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Domain-Name: None Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Identity-Status: Confirmed Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Is-Admin-Project: True Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Id: default Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Domain-Name: Default Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Project-Name: admin Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Role: member,admin,reader Jun 24 10:09:45.542385 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Roles: member,admin,reader Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_98caa12ca1b14e52b73e3cce22837778", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}] Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant: admin Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-Tenant-Name: admin Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User: admin Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Id: default Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Domain-Name: Default Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Id: 68ba5f09c78c41f18a7e1c6789016a58 Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: X-User-Name: admin Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: method: > Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: exception: Flavor 451 could not be found. Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: action_args: {'id': '451'} Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:45.543965 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:45.544913 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.546251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-469d3e06-c9ed-44b1-b78c-8a31448e09aa admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103304) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:45.547572 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-469d3e06-c9ed-44b1-b78c-8a31448e09aa admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.075090 Jun 24 10:09:45.547572 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 24/49] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Jun 24 10:09:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 24 10:09:45.554037 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-59a0291b-9c28-4220-b611-a60d73a7b443 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:45.568021 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-59a0291b-9c28-4220-b611-a60d73a7b443 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017834 Jun 24 10:09:45.568550 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 26/50] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Jun 24 10:09:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:45.577854 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:45.591945 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017643 Jun 24 10:09:45.592471 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 25/51] 10.222.0.64 () {60 vars in 1210 bytes} [Fri Jun 24 10:09:45 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:09:45.602111 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-a3e1c789-2fe4-461e-8104-6aea8202bd33 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:45.608317 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.wsgi [None req-a3e1c789-2fe4-461e-8104-6aea8202bd33 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-a3e1c789-2fe4-461e-8104-6aea8202bd33 admin admin] Request method failure captured: Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Accept: application/json Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Accept-Encoding: gzip, deflate Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Connection: keep-alive Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Content-Length: 0 Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Host: 10.222.0.64 Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Openstack-Api-Version: compute 2.90 Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Openstack-System-Scope: None Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: User-Agent: python-novaclient Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Auth-Token: gAAAAABitY1prN9_788ulAqfG7ezlhy7p8L3CdOuOYBtHYjt85Oz1Olu5440QaDONFH3dkhT1YOOvagwa5Pve5h0lkZ02H1ns89ys-64Nl1L1Z0mBN8MaMf0Ac2Byjfj9yf3dTXxNKL8LYRg45taTqlvbQ_CjbAKFo30Qlue-ZaRRMmmD-yh1lA Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Domain-Id: None Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Domain-Name: None Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Identity-Status: Confirmed Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Is-Admin-Project: True Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Openstack-Nova-Api-Version: 2.90 Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Domain-Id: default Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Domain-Name: Default Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Project-Name: admin Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Role: member,admin,reader Jun 24 10:09:45.609831 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Roles: member,admin,reader Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_98caa12ca1b14e52b73e3cce22837778", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/98caa12ca1b14e52b73e3cce22837778"}]}] Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant: admin Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant-Id: 98caa12ca1b14e52b73e3cce22837778 Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-Tenant-Name: admin Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User: admin Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Domain-Id: default Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Domain-Name: Default Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Id: 68ba5f09c78c41f18a7e1c6789016a58 Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: X-User-Name: admin Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: method: > Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: exception: Flavor 451 could not be found. Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: action_args: {'id': '451'} Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:09:45.611369 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:45.612294 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: ERROR nova.api.openstack.wsgi Jun 24 10:09:45.613604 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-a3e1c789-2fe4-461e-8104-6aea8202bd33 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103303) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:09:45.614664 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-a3e1c789-2fe4-461e-8104-6aea8202bd33 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.013036 Jun 24 10:09:45.614664 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 27/52] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Jun 24 10:09:45 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 24 10:09:46.546671 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:46.547968 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001980 Jun 24 10:09:46.548496 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 26/53] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:46.746076 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-185ff12c-b65e-4a2d-b467-79b630977eff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:46.772484 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-185ff12c-b65e-4a2d-b467-79b630977eff admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.085805 Jun 24 10:09:46.773248 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 28/54] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Jun 24 10:09:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:47.624164 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:47.625353 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001908 Jun 24 10:09:47.625794 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 27/55] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:47.830984 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-9186b6a8-12c8-4494-bfc7-59b9f3647e51 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:47.851857 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-9186b6a8-12c8-4494-bfc7-59b9f3647e51 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.078830 Jun 24 10:09:47.852401 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 29/56] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Jun 24 10:09:47 2022] POST /compute/v2.1/flavors => generated 405 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:48.678036 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:48.679102 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 24 10:09:48.679506 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 28/57] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:48.881602 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-f284e165-7651-4996-aa14-23c9a2eb3d9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:48.904629 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-f284e165-7651-4996-aa14-23c9a2eb3d9a admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.088458 Jun 24 10:09:48.905217 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 30/58] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Jun 24 10:09:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:49.727835 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:49.728846 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 24 10:09:49.729251 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 29/59] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:49.923248 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-564970a1-3728-4cec-81f7-28d6a678d827 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:09:49.942176 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-564970a1-3728-4cec-81f7-28d6a678d827 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076225 Jun 24 10:09:49.942745 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 31/60] 10.222.0.64 () {64 vars in 1235 bytes} [Fri Jun 24 10:09:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:09:50.761804 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:50.762841 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 24 10:09:50.763235 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 30/61] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:09:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:09:50.960474 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-3b588a1a-1bc0-41a2-90fa-f794934eff0a admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:09:50.980308 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-3b588a1a-1bc0-41a2-90fa-f794934eff0a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.082555 Jun 24 10:09:50.980854 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 32/62] 10.222.0.64 () {60 vars in 1202 bytes} [Fri Jun 24 10:09:50 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:10:37.995020 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:37.996045 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e5565990-137e-4c02-9049-d33cf7652378 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 24 10:10:37.996736 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 31/63] 10.222.0.64 () {54 vars in 930 bytes} [Fri Jun 24 10:10:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:10:38.009697 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:38.067249 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-3137b5e7-84f8-4746-b5c0-e81f06101367 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:38.090531 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-3137b5e7-84f8-4746-b5c0-e81f06101367 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.086199 Jun 24 10:10:38.091171 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 33/64] 10.222.0.64 () {60 vars in 1291 bytes} [Fri Jun 24 10:10:38 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:10:38.117022 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-e75e3c36-b897-40b1-baa3-70c1a5e4619e admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:38.122527 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG dbcounter [-] [103304] Writing DB stats nova_api:SELECT=14 {{(pid=103304) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:10:38.130875 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-e75e3c36-b897-40b1-baa3-70c1a5e4619e admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.019788 Jun 24 10:10:38.131583 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 32/65] 10.222.0.64 () {60 vars in 1282 bytes} [Fri Jun 24 10:10:38 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:38.147745 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-5b9a3611-d380-4817-9892-b845c0b8e4d8 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:38.155737 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-5b9a3611-d380-4817-9892-b845c0b8e4d8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011676 Jun 24 10:10:38.156326 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 34/66] 10.222.0.64 () {60 vars in 1285 bytes} [Fri Jun 24 10:10:38 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:10:38.168482 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:38.176701 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012084 Jun 24 10:10:38.177135 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 33/67] 10.222.0.64 () {60 vars in 1285 bytes} [Fri Jun 24 10:10:38 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:10:38.188951 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-8b7c7040-217f-4543-8803-3b59d032d54a admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:10:38.196732 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-8b7c7040-217f-4543-8803-3b59d032d54a admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011554 Jun 24 10:10:38.197265 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 35/68] 10.222.0.64 () {60 vars in 1282 bytes} [Fri Jun 24 10:10:38 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:14:04.466373 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:04.467665 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001752 Jun 24 10:14:04.468049 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 34/69] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:14:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:04.610415 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_api:SELECT=6 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:04.745080 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-d7d646c0-0dfd-47d3-b2a1-65299d55d3f5 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:04.746250 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:14:04.746250 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: warnings.warn(msg) Jun 24 10:14:04.747486 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-d7d646c0-0dfd-47d3-b2a1-65299d55d3f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:04.747913 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-d7d646c0-0dfd-47d3-b2a1-65299d55d3f5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:04.748853 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-d7d646c0-0dfd-47d3-b2a1-65299d55d3f5 admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:04.749287 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-d7d646c0-0dfd-47d3-b2a1-65299d55d3f5 admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:04.784112 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-d7d646c0-0dfd-47d3-b2a1-65299d55d3f5 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.176201 Jun 24 10:14:04.784672 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 36/70] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Jun 24 10:14:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:14:05.634519 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:05.635555 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Jun 24 10:14:05.635953 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 35/71] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:14:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:05.834541 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-4234ceb3-f0db-49ae-8d65-6a1bba9cf4a9 admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:05.835767 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:14:05.835767 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: warnings.warn(msg) Jun 24 10:14:05.837003 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-4234ceb3-f0db-49ae-8d65-6a1bba9cf4a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:05.837432 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-4234ceb3-f0db-49ae-8d65-6a1bba9cf4a9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:05.838189 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-4234ceb3-f0db-49ae-8d65-6a1bba9cf4a9 admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:05.838820 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-4234ceb3-f0db-49ae-8d65-6a1bba9cf4a9 admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:05.859231 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-4234ceb3-f0db-49ae-8d65-6a1bba9cf4a9 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.081262 Jun 24 10:14:05.859793 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 37/72] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Jun 24 10:14:05 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:14:17.118598 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:17.120093 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002098 Jun 24 10:14:17.120600 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 36/73] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:14:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:17.275209 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_cell0:SELECT=4 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:17.276271 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_cell1:SELECT=4 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:17.277315 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG dbcounter [-] [103303] Writing DB stats nova_api:SELECT=8 {{(pid=103303) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:14:17.337591 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-8ac28819-4f12-4dd7-9a2a-063c89e8405a admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:17.338773 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:14:17.338773 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: warnings.warn(msg) Jun 24 10:14:17.340022 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-8ac28819-4f12-4dd7-9a2a-063c89e8405a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:17.340462 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-8ac28819-4f12-4dd7-9a2a-063c89e8405a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:17.341277 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-8ac28819-4f12-4dd7-9a2a-063c89e8405a admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:17.341703 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-8ac28819-4f12-4dd7-9a2a-063c89e8405a admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:17.366885 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-8ac28819-4f12-4dd7-9a2a-063c89e8405a admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.099413 Jun 24 10:14:17.367440 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 38/74] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Jun 24 10:14:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:14:18.204531 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: DEBUG nova.api.openstack.wsgi [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] Calling method '>' {{(pid=103304) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:18.205629 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: INFO nova.api.openstack.requestlog [None req-a992b5cc-751a-4bdc-8b84-f326bcdc1c18 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001609 Jun 24 10:14:18.206035 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: [pid: 103304|app: 0|req: 37/75] 10.222.0.64 () {56 vars in 1074 bytes} [Fri Jun 24 10:14:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:14:18.417314 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG nova.api.openstack.wsgi [None req-516a85c7-d84c-4a1a-a153-8e4de435594f admin admin] Calling method '>' {{(pid=103303) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:14:18.418480 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 24 10:14:18.418480 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: warnings.warn(msg) Jun 24 10:14:18.419722 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-516a85c7-d84c-4a1a-a153-8e4de435594f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:18.420164 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-516a85c7-d84c-4a1a-a153-8e4de435594f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:18.420943 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-516a85c7-d84c-4a1a-a153-8e4de435594f admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:14:18.421368 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: DEBUG oslo_concurrency.lockutils [None req-516a85c7-d84c-4a1a-a153-8e4de435594f admin admin] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103303) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:14:18.443353 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: INFO nova.api.openstack.requestlog [None req-516a85c7-d84c-4a1a-a153-8e4de435594f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.087321 Jun 24 10:14:18.443909 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: [pid: 103303|app: 0|req: 39/76] 10.222.0.64 () {60 vars in 1193 bytes} [Fri Jun 24 10:14:18 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:15:14.393954 dv-cinder-847132-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 24 10:15:14.395060 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: Fri Jun 24 10:15:14 2022 - graceful shutdown triggered... Jun 24 10:15:14.395749 dv-cinder-847132-2-iscsi devstack@n-api.service[103303]: Gracefully killing worker 1 (pid: 103303)... Jun 24 10:15:14.396342 dv-cinder-847132-2-iscsi devstack@n-api.service[103304]: Gracefully killing worker 2 (pid: 103304)... Jun 24 10:15:15.395449 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: worker 1 buried after 1 seconds Jun 24 10:15:15.395449 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: worker 2 buried after 1 seconds Jun 24 10:15:15.395449 dv-cinder-847132-2-iscsi devstack@n-api.service[103302]: goodbye to uWSGI. Jun 24 10:15:15.397946 dv-cinder-847132-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 24 10:15:15.398818 dv-cinder-847132-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 24 10:15:15.402470 dv-cinder-847132-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 24 10:15:15.412194 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 24 10:15:15 2022] *** Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: nodename: dv-cinder-847132-2-iscsi Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: machine: x86_64 Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: clock source: unix Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: pcre jit disabled Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: detected number of CPU cores: 4 Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: current working directory: / Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: detected binary path: /usr/bin/uwsgi-core Jun 24 10:15:15.414217 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: your processes number limit is 47680 Jun 24 10:15:15.415202 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: your memory page size is 4096 bytes Jun 24 10:15:15.415202 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: detected max file descriptor number: 2048 Jun 24 10:15:15.415202 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: lock engine: pthread robust mutexes Jun 24 10:15:15.415202 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: thunder lock: enabled Jun 24 10:15:15.415202 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 24 10:15:15.415202 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 24 10:15:15.462425 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: Python main interpreter initialized at 0x5614bc1239c0 Jun 24 10:15:15.462425 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: python threads support enabled Jun 24 10:15:15.462425 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: your server socket listen backlog is limited to 100 connections Jun 24 10:15:15.462425 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: your mercy for graceful operations on workers is 90 seconds Jun 24 10:15:15.464122 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: mapped 403077 bytes (393 KB) for 2 cores Jun 24 10:15:15.464122 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: *** Operational MODE: preforking *** Jun 24 10:15:15.464122 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: *** uWSGI is running in multiple interpreter mode *** Jun 24 10:15:15.464122 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: spawned uWSGI master process (pid: 117836) Jun 24 10:15:15.463982 dv-cinder-847132-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 24 10:15:15.464753 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: spawned uWSGI worker 1 (pid: 117854, cores: 1) Jun 24 10:15:15.464875 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: spawned uWSGI worker 2 (pid: 117855, cores: 1) Jun 24 10:15:15.465779 dv-cinder-847132-2-iscsi devstack@n-api.service[117836]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 24 10:15:16.128274 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:15:16.129871 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 24 10:15:17.319944 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:15:17.319944 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: from cryptography.utils import int_from_bytes Jun 24 10:15:17.320734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:15:17.320734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: from cryptography.utils import int_from_bytes Jun 24 10:15:17.321154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:15:17.321154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: from cryptography.utils import int_from_bytes Jun 24 10:15:17.321333 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 24 10:15:17.321333 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: from cryptography.utils import int_from_bytes Jun 24 10:15:19.751892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:15:19.752551 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:15:19.753152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:15:19.753152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:15:19.753309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:15:19.753656 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.753986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.754317 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.754657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.755021 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.755413 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.755737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.756056 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.756387 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.756614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.756958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.757282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-2-iscsi {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.757603 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.757913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.758221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.758525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.758850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.759253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.759677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.760185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.761775 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.762101 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.762408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.762779 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.763095 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.763407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.763738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.764047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.764376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.764693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.765095 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-2-iscsi {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.765433 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.765759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.766073 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.766492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.766821 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.767149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.767474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.767593 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 24 10:15:19.768272 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 24 10:15:19.768381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.768381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.768560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 24 10:15:19.768641 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.768721 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 24 10:15:19.768799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.768893 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 24 10:15:19.769170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.769290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.769500 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.769597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.769795 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.769949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.770123 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.770251 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.770432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.770537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.770760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.770885 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771072 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.771930 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772558 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847132-2-iscsi {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772667 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.772986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.773145 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.773252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.773395 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.773531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.773693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.773803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774009 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774424 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774627 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.774960 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.775199 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.775314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.775599 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.775906 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.776138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.776238 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.776403 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.776510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.776721 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.776829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.777104 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.777291 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.777432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.777575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.777733 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.777867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.778050 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.778186 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.778464 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.778571 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.778739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.778861 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.779049 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.779158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.779397 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.779502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847132-2-iscsi {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.779716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.779844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780026 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780386 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780541 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780831 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.780984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.781090 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.781284 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.781424 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.781543 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.781734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.781913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782189 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782494 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782605 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782797 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.782969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783077 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783570 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.783979 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.784154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.784273 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.784457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.784563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.784773 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.784879 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785180 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785375 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.785937 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.786045 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.786253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.786349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.786565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.786669 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.786910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787012 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787284 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787391 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.787911 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788337 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788637 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.788940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.789143 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.789246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.789449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.789545 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.789750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.789937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.790034 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.790247 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.790351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.790560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.790655 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.791121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.791417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.791516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.791726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.791883 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.792141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.792243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.792397 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.792500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.792707 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.792875 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793045 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793143 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793327 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793424 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793743 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.793989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.794158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.794310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.794463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.794618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.794923 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.795100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.795252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.795419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.795563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.795706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.795863 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.796006 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.796156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.796307 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.797684 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.797858 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798467 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798624 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.798964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.799109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.799260 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.799411 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.799554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.799704 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.799865 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.800020 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.800174 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.800318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.800318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.800615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.800760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.800903 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.801055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.801198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.801349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.801511 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.801665 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.801817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.801971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.802125 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.802297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.802297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.802601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.802784 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.802945 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.803100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.803244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.803401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.803553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.803711 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.803862 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.804013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.804195 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.804347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.804506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.804657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.804810 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.804974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.805119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.805119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.805388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.805544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.805699 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.805850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.806002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.806154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.806305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.806513 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.806667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.806850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.806997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.806997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.807268 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.807422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.807565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.807717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.807868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.808011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.808163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.808163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.808163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.808590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.808742 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.808885 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.809040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.809183 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.809335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.809490 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.809671 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.809825 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.809984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.810128 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.810281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.810433 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.810747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.810953 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.811123 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.811278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.811278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.811565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.811715 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.811946 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.812106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.812266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.812418 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.812584 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.812728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.812879 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.813030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.813195 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.813348 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.813500 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.813653 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.813804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.813957 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 24 10:15:19.814108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.814252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.815926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.816768 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.816940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817411 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817711 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817867 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.817867 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.818147 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.818297 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.818452 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.818854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.819017 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.819335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.819643 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.819798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.819941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820244 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820395 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.820844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.821124 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.821275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.821472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.821472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.821765 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.821918 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.822129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.822291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.822436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.822588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.822764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.822923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823389 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.823968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.824143 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.824288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.824437 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.824580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.824722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.824873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825032 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825187 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825339 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825808 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.825951 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.826114 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.826265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.826419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.826562 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.826788 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.826940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.827083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.827226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.827379 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.827529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.827694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.827845 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828155 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828597 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.828889 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829476 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.829911 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.830952 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.831107 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.831250 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.831400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.831544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.831695 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.831857 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832311 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832454 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.832908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.833935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.834084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.834235 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.834377 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.834533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.834677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.834879 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835593 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.835902 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836052 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836205 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.836944 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.837095 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.837238 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.837388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.837542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.837722 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.837876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838034 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838188 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838331 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838481 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838797 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.838959 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.839112 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.839254 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.839403 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.839563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.839717 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.839863 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840164 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840307 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840687 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840841 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.840993 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.841151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.841294 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.841443 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.841613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.841768 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.841920 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.842062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.842062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.842330 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.842330 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.842330 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.843144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.843296 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.843447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.843590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.843741 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.843897 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844048 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844778 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.844929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845387 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845690 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845841 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.845984 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.846134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.846293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.846437 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.846578 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.846751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.846900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847044 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847202 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847505 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847809 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.847961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848408 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848845 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.848989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.849133 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.849283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.849426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.849581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.849738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.849891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850177 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850328 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850471 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850624 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850798 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.850955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.851106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.851250 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.851402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.851565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.851720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.851864 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852158 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852311 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852463 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.852919 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.853063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.853258 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.853533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.853731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.853877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.854030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.854186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.854339 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.854490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.854640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.854901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855048 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855201 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855352 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.855938 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856240 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856382 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.856975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857260 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857409 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.857854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.858246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.858396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.858538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.858691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.858868 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859155 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859305 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859472 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.859901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860345 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860653 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.860960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.861110 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.861274 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.861450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.861615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.861766 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.861922 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.862071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.862231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.862382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.862531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.862679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.862870 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863032 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863190 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863504 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863504 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.863968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.864126 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.864283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.864441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.864597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.864754 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.864921 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865228 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865559 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865718 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865881 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.865881 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.866166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.866322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.866472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.866635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.866869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867172 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867331 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867500 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867650 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867809 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.867966 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.868117 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.868356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.868516 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.868675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.868857 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.869025 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.869187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.869338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.869486 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.869645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.869848 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.870070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.870245 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.870405 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.870555 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.870740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.870898 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.871061 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.871228 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.871385 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.871546 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.871697 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.871857 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872324 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872631 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.872945 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.873104 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.873264 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.873422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.873573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.873744 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.873905 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.874062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.874062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.874364 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.874515 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.874673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.874673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875180 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875330 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.875979 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.876137 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.876287 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.876437 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.876635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.876788 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.876937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877243 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877393 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877715 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.877877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.878166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.878317 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.878475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.878626 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.878803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.878956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.879123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.879288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.879438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.879599 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.879599 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.879892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880049 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880214 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880366 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880521 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880672 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.880969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.881127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.881278 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.881436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.881601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.881780 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.881940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.882090 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.882238 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.882387 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.882550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.882756 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.882966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.883139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.883290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.883440 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.883603 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.883764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.883926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.884085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.884235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.884384 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.884615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.884771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.884928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.885086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.885236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.885396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.885396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.885691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.885842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886002 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.886931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.887094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.887255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.887405 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.887554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.887710 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.887868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.888958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.889109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.889258 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.889406 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.889563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.889713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.889886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.890037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.890194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.890343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.890510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.890669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.890892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.891053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.891213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.891376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.891527 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.891684 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.891885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.892056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.892215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.892380 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.892531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.892699 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.892858 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893007 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893306 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893464 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893623 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.893932 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.894090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.894241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.894241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.894546 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.894718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.894877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895026 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895344 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895653 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895810 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.895959 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.896126 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.896290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.896441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.896599 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.896748 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.896905 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897214 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897365 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897832 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.897993 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.898160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.898318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.898477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.898627 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.898819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.898973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.899210 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.899362 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.899523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.899680 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.899830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.899978 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.900228 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.900396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.900548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.900706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.900866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901641 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.901950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.902101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.902261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.902414 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.902571 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.902749 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.902929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.903082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.903232 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.903392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.903542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.903703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.903865 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.904979 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.905128 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.905276 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.905426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.905589 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.905747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.905898 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.906048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.906217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.906375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.906613 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.906785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.906941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907102 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907849 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.907998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.908162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.908338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.908498 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.908656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.908804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.908954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.909102 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.909268 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.909427 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.909584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.909735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.909891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.910049 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.910208 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.910369 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.910520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.910677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.910869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.911108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.911294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.911456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.911614 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.911766 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.911914 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.912074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.912225 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.912374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.912535 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.912692 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.912843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913167 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913317 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913468 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913766 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.913924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.914082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.914233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.914390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.914550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.914798 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.914975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.915129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.915280 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.915439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.915589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.915782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.915938 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.916088 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.916088 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.916382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.916552 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.916716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.916866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917337 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917646 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.917954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.918104 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.918253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.918402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.918576 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.918776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.918933 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.919083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.919244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.919409 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.919561 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.919712 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.919861 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920009 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920320 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920478 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.920948 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921430 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921636 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921947 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.921947 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.922237 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.922402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.922571 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.922740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.922896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923671 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.923979 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.924129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.924277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.924277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.924579 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.924738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.924903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.925069 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.925229 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.925379 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.925537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.925698 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.925856 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926014 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926164 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926313 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.926980 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.927129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.927285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.927445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.927596 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.927755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.927906 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.928055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.928288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.928447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.928597 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.928756 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.928907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.929967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.930126 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.930275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.930424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.930583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.930751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.930917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.931086 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.931256 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.931525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.931711 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.931863 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932029 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932029 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932313 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932462 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932622 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.932959 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.933110 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.933260 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.933409 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.933558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.933707 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.934201 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.934362 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.934513 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.934663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.934869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935196 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935348 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935816 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.935816 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.936109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.936268 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.936419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.936568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.936716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.936878 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937646 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937810 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.937960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.938118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.938269 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.938426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.938583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.938771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.938937 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939859 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.939859 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.940152 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.940309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.940469 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.940620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.940779 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.940929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.941095 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.941250 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.941416 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.941567 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.941716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.941874 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.942030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.942180 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.942343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.942495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.942651 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.942841 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943004 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943641 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943791 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.943940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.944099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.944249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.944399 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.944550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.944550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.944831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945742 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.945905 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946056 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946205 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946205 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946849 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.946849 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.947197 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.947348 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.947508 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.947674 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.947835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.947984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.948133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.948289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.948446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.948605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.948765 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.948917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.949085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.949236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.949386 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.949386 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.949699 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.949858 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.950015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.950174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.950338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.950498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.950658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.950909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951029 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951126 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951307 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951390 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951480 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.951970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952066 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952327 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952607 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952837 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.952978 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953269 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953345 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953712 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953884 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953978 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.953978 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954222 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954312 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954395 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954643 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954848 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.954931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955043 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955133 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955228 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955312 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955820 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955902 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.955991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956548 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956631 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956811 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.956974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957157 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957241 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957492 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957575 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957665 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957753 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957836 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.957927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958280 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958524 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.958954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959126 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959482 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959617 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959712 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959891 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.959973 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960324 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960413 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960497 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.960926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.961010 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.961103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.961186 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.961284 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.961992 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.962103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.962189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.962281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.962377 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.962472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.962556 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963443 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963443 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963604 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.963917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.964056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.964199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.964310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.964540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.964680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.964836 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.965070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.965217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.965366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.965470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.965723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.965862 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.966048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.966205 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.966309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.966397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.966647 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.966817 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.967002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.967139 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.967329 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.967469 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.967966 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968069 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968302 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968440 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968617 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968765 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968898 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.968998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.969217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.969355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.969538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.969675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.969840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.969948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.970133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.970233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.970509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.970606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.971205 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.971297 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.971371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.971497 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972572 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972666 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972746 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.972988 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973139 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973519 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973839 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.973926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974382 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974686 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.974942 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975235 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975367 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975681 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.975954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.976160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.976254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.976465 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.976585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.976773 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.976883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977072 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977377 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977468 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977755 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.977976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.978300 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.978450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.978868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.979230 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.979336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.979650 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.979748 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.979830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.979909 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.980123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.980209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.980433 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.980526 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.980737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.980827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981514 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.981965 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983421 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983514 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983599 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.983946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984120 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984308 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984495 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984679 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984888 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.984983 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.985212 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.985308 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.985520 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.985611 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.985847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.986160 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.986253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.986488 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.986588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.986830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.986947 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.987164 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.987266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.987492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.987586 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.987791 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.987884 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.988092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.988193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.988388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.988480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.988695 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.988788 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989000 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989407 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989612 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.989911 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990518 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990612 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990845 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.990940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.991151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.991268 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.991451 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.991544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.991741 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.991833 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992140 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992343 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992433 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992741 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.992949 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.993079 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.993255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.993362 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.993559 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.993650 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.993909 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.994001 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.994224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.994527 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.994811 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.994919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.995141 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.995234 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.995439 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.995527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.995746 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.995844 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.996058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.996157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.996366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.996457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.996682 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.996782 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.997004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.997094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.997312 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.997402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.997615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.997714 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.998009 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.998165 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.998337 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.998484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.998655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.998828 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:19.999970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.000102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.000302 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.000400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.000591 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.000717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.000899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.001026 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.001211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.001358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.001541 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.001693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.001866 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002174 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002505 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.002971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.003236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.003367 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.003456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.003568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.003763 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.003887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.004091 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.004192 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.004401 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.004500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.004710 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.004801 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005128 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005724 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.005932 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006043 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006230 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006321 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006631 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006854 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.006964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.007156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.007261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.007456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.007556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.007755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.007847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008054 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008789 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.008956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.009118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.009255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.009437 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.009639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.009852 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.010160 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.010403 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117854) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:15:20.010493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.010788 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.011125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.011464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.011781 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.012103 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.012415 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.012737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.013043 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.013373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.013687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.013986 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.014294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.014625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.014960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.015269 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.015577 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.015883 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.016244 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.017160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.017160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.017160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.017435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.017716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.018032 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.018351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.018664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.018997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.019324 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.019633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.019939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.020252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.020560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.020867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.021186 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.021499 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.021821 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.022142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.022449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.022793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.023119 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.023519 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.023766 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.024105 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.024432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.024741 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.025050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.025956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 24 10:15:20.026205 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117855) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 24 10:15:20.071487 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO dbcounter [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Registered counter for database nova_api Jun 24 10:15:20.087951 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO dbcounter [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Registered counter for database nova_api Jun 24 10:15:20.092162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_db.sqlalchemy.engines [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.099720 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writer thread running {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.109502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_db.sqlalchemy.engines [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.116573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writer thread running {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.156992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.context [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c7d15be-2aaf-4832-94f4-0ad39b6d90ec(cell1) {{(pid=117854) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:15:20.161156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:15:20.162797 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:15:20.163598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:15:20.165555 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:15:20.167612 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO dbcounter [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Registered counter for database nova_cell0 Jun 24 10:15:20.171678 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO dbcounter [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Registered counter for database nova_cell1 Jun 24 10:15:20.174872 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.context [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5c7d15be-2aaf-4832-94f4-0ad39b6d90ec(cell1) {{(pid=117855) load_cells /opt/stack/nova/nova/context.py:464}} Jun 24 10:15:20.179037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:15:20.179342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_db.sqlalchemy.engines [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.180652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:15:20.180996 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_db.sqlalchemy.engines [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.181592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:15:20.183911 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:15:20.185950 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO dbcounter [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Registered counter for database nova_cell0 Jun 24 10:15:20.186342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writer thread running {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.190045 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO dbcounter [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Registered counter for database nova_cell1 Jun 24 10:15:20.198975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_db.sqlalchemy.engines [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.200708 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_db.sqlalchemy.engines [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.205722 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writer thread running {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.208927 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writer thread running {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.331355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writer thread running {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.347517 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO dbcounter [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Registered counter for database nova_cell0 Jun 24 10:15:20.355105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_db.sqlalchemy.engines [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117854) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.360415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writer thread running {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.362754 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO dbcounter [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Registered counter for database nova_cell0 Jun 24 10:15:20.370652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_db.sqlalchemy.engines [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117855) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 24 10:15:20.375539 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writer thread running {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 24 10:15:20.678969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: WARNING keystonemiddleware.auth_token [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:15:20.686853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: WARNING keystonemiddleware.auth_token [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:15:20.696660 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: WARNING keystonemiddleware.auth_token [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:15:20.705013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: WARNING keystonemiddleware.auth_token [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:15:21.036716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: WARNING keystonemiddleware.auth_token [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:15:21.042902 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: WARNING keystonemiddleware.auth_token [None req-a765ac45-0b60-4c87-9ce8-ca3a9d20d4c5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:15:21.048244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614bc1239c0 pid: 117854 (default app) Jun 24 10:15:21.058593 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: WARNING keystonemiddleware.auth_token [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 24 10:15:21.064586 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: WARNING keystonemiddleware.auth_token [None req-988956ea-2e22-4f51-8fc7-bf6e36e181b7 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 24 10:15:21.069897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5614bc1239c0 pid: 117855 (default app) Jun 24 10:16:15.912851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:15.918087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:15.922129 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:15.924541 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:16.905077 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-af6b3a02-4d1c-454c-b6f5-a5dc36cbafdc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'create', calling method: .version_select at 0x7f3776aab700>, body: {"keypair": {"name": "tempest-keypair-1588499818", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFsJygnsUhXHiA0J5i3QydJjQpGET8oAGZDrXpA5Ao3R/27OcA1VDxB65mMjYquMelt/62TfUEpGktSfPsDN/O9Z//AXxQ34d2Mm09C0tphtJzb5ReCww+q95bJx3VCieQ=="}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:17.057256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-af6b3a02-4d1c-454c-b6f5-a5dc36cbafdc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for project 74111042535d44c8a52a4656eb37fa23. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:17.088576 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-af6b3a02-4d1c-454c-b6f5-a5dc36cbafdc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for user 0a66b13572904a309d3180afc7278070 and project 74111042535d44c8a52a4656eb37fa23. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:17.237987 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-af6b3a02-4d1c-454c-b6f5-a5dc36cbafdc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.360798 Jun 24 10:16:17.238846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 1/1] 10.222.0.64 () {62 vars in 1199 bytes} [Fri Jun 24 10:16:15 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1366 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 24 10:16:20.921626 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-249034273", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77e0b315-c6f0-401c-b090-3f73b33dd671"}], "security_groups": [{"name": "tempest-securitygroup--1373160035"}], "key_name": "tempest-keypair-1588499818", "user_data": "}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:20.947573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:20.949429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:20.950589 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:20.951579 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:21.716057 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5bfa8d36-d3f7-46b2-b951-3c2ec88f6c9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: .version_select at 0x7f377696c790>, body: {"keypair": {"name": "tempest-keypair-628857789", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJktPHjpGAGkHu0EFGG+l94Rd4BwlY7+4+85Zos722s4psNbA/wW6RdCVrwWoAnlV7uklt/koBWZ8QlxyRoVk4X60gykVowCsZgUzRcUppeHPoJk4yf754n3jQn8vNusYA=="}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:21.755525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-5bfa8d36-d3f7-46b2-b951-3c2ec88f6c9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:21.761532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-5bfa8d36-d3f7-46b2-b951-3c2ec88f6c9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for user 6ca14b36fc754fe9b24abdfecf0f64c0 and project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:21.815996 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5bfa8d36-d3f7-46b2-b951-3c2ec88f6c9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.277370 Jun 24 10:16:21.821475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 2/2] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:16:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:22.912390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] validate_networks() for [('77e0b315-c6f0-401c-b090-3f73b33dd671', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:16:25.390617 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-595226268", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "networks": [{"uuid": "18282298-713d-408d-ae8c-c3fdda8948db"}]}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:25.782315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:16:25.782922 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:16:25.783485 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:16:25.783867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:16:25.784281 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:16:25.815741 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:25.816506 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:25.817473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:25.818069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:25.941725 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for project 74111042535d44c8a52a4656eb37fa23. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:25.964760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for user 0a66b13572904a309d3180afc7278070 and project 74111042535d44c8a52a4656eb37fa23. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:26.012804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:16:26.021011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:16:26.183215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-18b1a627-9267-49c1-9d84-a489be47eacd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 5.731718 Jun 24 10:16:26.183876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 1/3] 10.222.0.64 () {62 vars in 1187 bytes} [Fri Jun 24 10:16:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 5734 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 24 10:16:26.921276 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1176808169", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:27.060896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] validate_networks() for [('d20895ef-2afb-4e4b-a39f-18a1a6f9b4f5', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:16:27.879642 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] validate_networks() for [('18282298-713d-408d-ae8c-c3fdda8948db', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:16:28.403946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:16:28.404931 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:16:28.405603 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:16:28.406439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:16:28.407166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:16:28.427531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:28.430435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:28.434013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:28.437827 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:28.507731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:28.516084 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for user acbafaab99f848828c304ca5a45a55dc and project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:28.544054 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:16:28.546281 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:16:28.663176 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3ebe9692-0724-4bd1-a47c-285c5a552bdc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.478003 Jun 24 10:16:28.667691 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 2/4] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:16:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2483 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:16:28.674438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6a23fdb8-7925-4f31-b9b2-87409fbc8682 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:28.682031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6a23fdb8-7925-4f31-b9b2-87409fbc8682 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:28.888238 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6a23fdb8-7925-4f31-b9b2-87409fbc8682 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:28.911619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6a23fdb8-7925-4f31-b9b2-87409fbc8682 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:28.927243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6a23fdb8-7925-4f31-b9b2-87409fbc8682 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:28.929003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6a23fdb8-7925-4f31-b9b2-87409fbc8682 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1281 microversion: 2.20 time: 0.259631 Jun 24 10:16:28.929948 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 3/5] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:28 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1281 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:28.937160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-19368315", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5489725-cb1e-4af4-bc56-f04397965dc8"}], "security_groups": [{"name": "tempest-securitygroup--1775062853"}], "key_name": "tempest-keypair-628857789", "user_data": "}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:29.175997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] validate_networks() for [('d5489725-cb1e-4af4-bc56-f04397965dc8', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:16:30.644304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:16:30.644939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:16:30.645199 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:16:30.645622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:16:30.646036 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:16:30.663349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.663853 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.667525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.667989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.695355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:16:30.696004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:16:30.696523 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:16:30.696937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:16:30.697460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:16:30.724030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.724474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.724900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:30.726410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:30.727376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:30.730583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for user 6ca14b36fc754fe9b24abdfecf0f64c0 and project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:30.758186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Getting quotas for project 54baeb39b08b4d69aac8c4d42043112a. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:30.763023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Getting quotas for user fe9a62b8fcdc400b9ceb993bb8f936e0 and project 54baeb39b08b4d69aac8c4d42043112a. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:30.773662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:16:30.776372 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:16:30.779501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:16:30.785824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:16:30.995324 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-59d3e79b-fca7-490f-a6d5-7b70859df9e5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.954426 Jun 24 10:16:31.004668 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 3/6] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:16:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 5964 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:16:31.012074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:31.014166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:31.042831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:31.043896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-88e0632f-9cb4-4e47-85a5-abe7e634c444 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.112687 Jun 24 10:16:31.044557 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 4/7] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:16:28 2022] POST /compute/v2.1/servers => generated 402 bytes in 2114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:16:31.045930 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:31.047088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:31.048794 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:31.049252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:31.049860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:31.074685 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:31.075063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:31.075862 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:31.076296 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:31.470370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:31.540211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4f119945-6be3-4bbb-ab94-3876b6edfa57 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1274 microversion: 2.1 time: 0.533336 Jun 24 10:16:31.564098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:31 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1274 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:31.578187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-df9a4071-2657-42d5-9e09-3ccb6c785edc tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:31.588016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-df9a4071-2657-42d5-9e09-3ccb6c785edc tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:31.644637 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:31.747896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-df9a4071-2657-42d5-9e09-3ccb6c785edc tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:31.760645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:31.766886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:31.769042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c8aa1d65-4140-475b-98e0-194b7154cef9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1339 microversion: 2.20 time: 0.723508 Jun 24 10:16:31.771623 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 5/9] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:31 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1339 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:31.782726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-264ed819-9835-4c49-982b-83320957819a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:31.787096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-264ed819-9835-4c49-982b-83320957819a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:31.792256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-df9a4071-2657-42d5-9e09-3ccb6c785edc tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1214 microversion: 2.1 time: 0.225472 Jun 24 10:16:31.792872 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:31 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1214 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:32.003138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-264ed819-9835-4c49-982b-83320957819a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:32.018374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-264ed819-9835-4c49-982b-83320957819a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1235 microversion: 2.1 time: 0.243976 Jun 24 10:16:32.039273 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:31 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1235 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:32.171632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-634871241", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:32.287075 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] validate_networks() for [('d20895ef-2afb-4e4b-a39f-18a1a6f9b4f5', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:16:32.792149 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:32.793610 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:32.803829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:32.805009 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:32.807386 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:32.811217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.207769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.249867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.251779 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.260237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-cc5d65f4-9934-4d96-89c7-4a9510c1a8d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1339 microversion: 2.20 time: 0.474444 Jun 24 10:16:33.263458 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 7/12] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:32 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1339 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:33.282640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:16:33.283875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:16:33.284599 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:16:33.285192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:16:33.285341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:33.285888 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:16:33.286011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:33.313137 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.315409 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.318260 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.318487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.323498 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.325577 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.326865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.327733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.453302 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:16:33.485598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for user acbafaab99f848828c304ca5a45a55dc and project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:16:33.532325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:16:33.539392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:16:33.565557 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.580975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7e1101bf-a9e3-4ec8-9019-27ec84e8a0b9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1266 microversion: 2.1 time: 0.313929 Jun 24 10:16:33.595903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 8/13] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:33 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1266 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:33.608262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:33.618132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:33.652199 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.654349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.656216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:33.657668 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:33.666752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1884cdaf-22ee-471b-8e78-59e949664568 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.500984 Jun 24 10:16:33.669341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 6/14] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:16:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 1506 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:16:33.703877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d8ec9f36-9e4d-4c44-bef5-f4f088f4e205 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:33.705615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d8ec9f36-9e4d-4c44-bef5-f4f088f4e205 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:33.915031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:33.959038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-06b9f4d8-bfbc-44ca-9123-d3546e40b6f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1295 microversion: 2.1 time: 0.359273 Jun 24 10:16:33.959790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 9/15] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:33 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1295 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:34.164275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d8ec9f36-9e4d-4c44-bef5-f4f088f4e205 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:34.173360 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d8ec9f36-9e4d-4c44-bef5-f4f088f4e205 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1221 microversion: 2.1 time: 0.496078 Jun 24 10:16:34.174071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 7/16] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:33 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1221 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:34.281713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:34.282589 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:34.298094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:34.300641 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:34.301645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:34.302298 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:34.604579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:34.606110 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:34.619250 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:34.620069 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:34.621093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:34.622154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:35.332034 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:35.341405 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-cb06c3f8-1b22-415a-9f61-be37ab25b5f2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1272 microversion: 2.1 time: 0.741857 Jun 24 10:16:35.347487 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 8/17] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:34 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1272 bytes in 749 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:35.364690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:35.365361 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:35.393361 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:35.393820 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:35.399173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:35.399970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:35.720382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:35.731277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-13fb12be-f474-442f-b41d-412fce750154 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1293 microversion: 2.1 time: 0.382406 Jun 24 10:16:35.742347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 9/18] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:35 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1293 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:35.749856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:35.751488 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:35.765886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:35.767213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:35.768266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:35.769091 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:35.838297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:35.878299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:35.882805 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:35.884296 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b1a5439a-6a75-4d81-987a-86bf2c7b4c0a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 1.606507 Jun 24 10:16:35.897590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 10/19] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:34 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 1620 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:36.365816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:36.366926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:36.384784 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:36.385822 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:36.401078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:36.405102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:37.412179 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:37.443629 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:37.478015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-89537746-ba30-4536-95e6-d37a044b281d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1281 microversion: 2.1 time: 1.728865 Jun 24 10:16:37.479558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 10/20] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:35 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1281 bytes in 1736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:37.497642 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:37.497861 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d9f49a3f-f38f-4156-837c-01ed36400116 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1272 microversion: 2.1 time: 1.124047 Jun 24 10:16:37.498484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 11/21] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:36 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1272 bytes in 1138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:37.504755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:37.505343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:37.507247 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:37.527252 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:37.527714 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:37.534311 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:37.534966 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:37.536206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:37.536781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:37.540200 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:37.540699 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:37.735817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:37.746666 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-01786e99-b5f5-4435-ba0c-682881ee3dc3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1293 microversion: 2.1 time: 0.264001 Jun 24 10:16:37.747622 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 11/22] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:37 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1293 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:38.497345 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:38.498047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:38.513492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:38.515813 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:38.517153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:38.519731 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:38.897140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:38.946377 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e0c0645b-300a-4e54-96db-f1dd6e0aafd9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1279 microversion: 2.1 time: 0.452971 Jun 24 10:16:38.952577 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 12/23] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:38 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1279 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:38.975311 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:38.977491 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:39.007373 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:39.008673 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:39.013937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:39.021140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:39.512427 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:39.526657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:39.531872 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:39.539968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-87186b7c-39a4-494b-8f10-137e7bb142f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 2.036530 Jun 24 10:16:39.542877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 12/24] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:37 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 2044 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:39.557374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:39.560911 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:39.580587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:39.583796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:39.587810 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:39.588689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:40.192606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:40.201807 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-95a276eb-8266-412d-ac78-e307be5bf0f1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 1.247437 Jun 24 10:16:40.214532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 13/25] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:38 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:40.230277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:40.231561 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:40.242853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:40.243540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:40.244495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:40.245446 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:40.410771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:40.419903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4d42cd25-2057-47c9-9947-633fa9d9686b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.875201 Jun 24 10:16:40.426295 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 13/26] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:39 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:40.562581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:40.563506 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:40.581806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:40.591346 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:40.592974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:40.593570 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:40.691196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:41.564522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:41.573825 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7b2c8157-2ee3-4c8a-9e6f-0234f94cfcbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 1.355808 Jun 24 10:16:41.575320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 14/27] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:40 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:41.591036 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:41.592162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:41.606484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:41.610351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:41.611412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:41.611867 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:41.768900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:41.782584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:41.785185 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:41.786600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5e913598-34f7-494e-b4c2-75d3c0057470 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 1.229129 Jun 24 10:16:41.787647 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 14/28] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:40 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 1231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:16:41.880603 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-e258243e-34ee-4973-af8c-c286ba3db939 req-76983e2a-4af1-4180-a053-6926275eafa5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95be179c-5caf-487f-a710-6445f6163f51", "tag": "05874f33-e136-4a35-af2c-074f2098eaf9"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:41.918515 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e258243e-34ee-4973-af8c-c286ba3db939 req-76983e2a-4af1-4180-a053-6926275eafa5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:41.919175 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e258243e-34ee-4973-af8c-c286ba3db939 req-76983e2a-4af1-4180-a053-6926275eafa5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:41.939954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-e258243e-34ee-4973-af8c-c286ba3db939 req-76983e2a-4af1-4180-a053-6926275eafa5 service nova] Creating event network-changed:05874f33-e136-4a35-af2c-074f2098eaf9 for instance 95be179c-5caf-487f-a710-6445f6163f51 on hv-cinder-84713 Jun 24 10:16:41.940726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e258243e-34ee-4973-af8c-c286ba3db939 req-76983e2a-4af1-4180-a053-6926275eafa5 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 10:16:41.941832 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:41.942421 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:41.943376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:41.944123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:41.953803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.compute.rpcapi [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 10:16:41.955078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] Releasing lock "compute-rpcapi-router" {{(pid=117855) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 10:16:41.974767 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2de288a5-9fd2-4489-b286-36d281cb73aa None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.184457 Jun 24 10:16:41.976633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 15/29] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:41.985835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:41.987670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:41.997165 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:41.998590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:42.000162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:42.001181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:42.010154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=22 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:42.113354 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:42.126294 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-428976fd-fd1b-49a6-8bbc-d5c58413b6f7 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.549129 Jun 24 10:16:42.128828 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 15/30] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:41 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:42.564463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:42.578208 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-13e507c5-5bda-4b7f-8032-83cd8b8f02b6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.598956 Jun 24 10:16:42.578964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 16/31] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:41 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:42.607426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:42.612840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:42.622613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:42.623340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:42.624488 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:42.626242 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:42.805969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:42.806596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:42.817430 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:42.817897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:42.819606 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:42.820267 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.000336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:43.021351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4bec73c0-8e9c-490f-b713-3ad59a2a09bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.434088 Jun 24 10:16:43.031945 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 16/32] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:42 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:43.152706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:43.170976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:43.175265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:43.177279 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-65472316-4e39-4fe5-a102-5f5456650db0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.376660 Jun 24 10:16:43.178380 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 17/33] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:42 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:16:43.184533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:43.185374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:43.203526 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.203978 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.208778 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.211885 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.305178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-31c813db-55dd-46ae-a616-7cce1ebf845a req-cb6d890e-f4a9-410b-b001-2e46753cb0e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1", "tag": "c453626e-6db1-429e-a1a1-df11a4d87ee5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:43.350191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-31c813db-55dd-46ae-a616-7cce1ebf845a req-cb6d890e-f4a9-410b-b001-2e46753cb0e6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.350644 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-31c813db-55dd-46ae-a616-7cce1ebf845a req-cb6d890e-f4a9-410b-b001-2e46753cb0e6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.416404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=4 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:43.422922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-31c813db-55dd-46ae-a616-7cce1ebf845a req-cb6d890e-f4a9-410b-b001-2e46753cb0e6 service nova] Creating event network-changed:c453626e-6db1-429e-a1a1-df11a4d87ee5 for instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 on hv-cinder-84713 Jun 24 10:16:43.425177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-31c813db-55dd-46ae-a616-7cce1ebf845a req-cb6d890e-f4a9-410b-b001-2e46753cb0e6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 24 10:16:43.427257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.429518 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.431799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.433318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.448507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.compute.rpcapi [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 24 10:16:43.450765 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] Releasing lock "compute-rpcapi-router" {{(pid=117854) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 24 10:16:43.480144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9671c1d7-957f-4f29-844d-5fd113a0eacd None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.343503 Jun 24 10:16:43.483048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 17/34] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:43.563552 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:43.576245 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a3f56288-3b30-4783-b2d5-f833dd9dd1d6 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.396436 Jun 24 10:16:43.577506 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 18/35] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:43 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:43.597285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:43.598179 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:43.605880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.606737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.607611 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:43.610614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:43.782658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:43.793544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e7bf9133-e947-4c82-9d56-979c7abccbf0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.199732 Jun 24 10:16:43.794437 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 18/36] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:43 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:43.995479 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-f4d2734b-0b0b-496d-928e-5dea82679ad5 req-23378a2e-4b7b-4d66-8e68-94daaf2c0210 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:44.009217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f4d2734b-0b0b-496d-928e-5dea82679ad5 req-23378a2e-4b7b-4d66-8e68-94daaf2c0210 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.009662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f4d2734b-0b0b-496d-928e-5dea82679ad5 req-23378a2e-4b7b-4d66-8e68-94daaf2c0210 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.039532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:44.040550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:44.041977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-f4d2734b-0b0b-496d-928e-5dea82679ad5 req-23378a2e-4b7b-4d66-8e68-94daaf2c0210 service nova] Creating event network-changed:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:16:44.056148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-f4d2734b-0b0b-496d-928e-5dea82679ad5 req-23378a2e-4b7b-4d66-8e68-94daaf2c0210 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064788 Jun 24 10:16:44.057092 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 19/37] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:44.057980 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.058556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.059462 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.059970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.172694 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=24 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:44.198322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:44.198910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:44.218613 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.220758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.221563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.226179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.344883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:44.359003 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1e551aef-9d3c-4b7e-9c86-7a3951309bfd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.321747 Jun 24 10:16:44.359003 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 19/38] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:44 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:44.503995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:44.515780 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:44.517665 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:44.518823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6942d171-47d8-4d7a-abd3-c0289c7f6b30 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.325854 Jun 24 10:16:44.525910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 20/39] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:44 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:44.595619 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:44.596473 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:44.604978 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.605436 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.606219 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.606657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.801667 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:44.810076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:44.810688 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:44.813140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c7e250be-8e39-4d59-a343-8ca501e5e79d tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.222531 Jun 24 10:16:44.820239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.820873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.822291 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:44.822759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:44.825819 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 20/40] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:44 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:44.986605 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:44.995085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c5ef6629-5599-4e66-8466-d4b38dca00e9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.189412 Jun 24 10:16:44.996135 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 21/41] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:44 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:45.373705 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:45.374241 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:45.380749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.381142 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.381922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.382364 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.498522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-e3b2f7c7-2ea9-4410-a9a9-11b36e25e6de req-42034313-a0df-4143-8594-927b9a110336 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e33ad457-f04e-45ab-994a-de25ed757120", "tag": "90942a6e-0933-48c1-80c9-55ff402f0b93"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:45.507793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e3b2f7c7-2ea9-4410-a9a9-11b36e25e6de req-42034313-a0df-4143-8594-927b9a110336 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.508696 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e3b2f7c7-2ea9-4410-a9a9-11b36e25e6de req-42034313-a0df-4143-8594-927b9a110336 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.520340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-e3b2f7c7-2ea9-4410-a9a9-11b36e25e6de req-42034313-a0df-4143-8594-927b9a110336 service nova] Creating event network-changed:90942a6e-0933-48c1-80c9-55ff402f0b93 for instance e33ad457-f04e-45ab-994a-de25ed757120 on hv-cinder-84713 Jun 24 10:16:45.526528 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:45.527491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-e3b2f7c7-2ea9-4410-a9a9-11b36e25e6de req-42034313-a0df-4143-8594-927b9a110336 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032858 Jun 24 10:16:45.528101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 22/42] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:45.536091 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e90d8f22-c842-4927-abcd-e163ec9d1ac5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.166246 Jun 24 10:16:45.536809 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 21/43] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:45 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:45.538491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:45.539229 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:45.545721 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.546172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.546964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.547402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.551475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:45.683316 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:45.691505 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:45.693019 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:45.694272 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d90c1373-3928-4e01-85cf-deab58dd3d57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.160096 Jun 24 10:16:45.699819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 23/44] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:45 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:45.831623 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:45.832265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:45.838404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.838861 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.839665 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:45.840098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:45.996911 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:46.006052 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-15d1e234-b366-486d-ba88-d9b4c5930973 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.178285 Jun 24 10:16:46.007263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 22/45] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:45 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:46.022867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:46.024531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:46.045341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.047279 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.049188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.050184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.121230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-0bd0d222-4328-4a64-a55f-9f0ce2ab81da req-18ebe046-978b-4623-8e6d-0b359f3eb029 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be1b257c-d6c5-4686-96f2-73dfcb9516ef", "tag": "f5b17bbb-f70d-4036-a17a-05e70d05ead8"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:46.131422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=8 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:46.154510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-0bd0d222-4328-4a64-a55f-9f0ce2ab81da req-18ebe046-978b-4623-8e6d-0b359f3eb029 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.155114 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-0bd0d222-4328-4a64-a55f-9f0ce2ab81da req-18ebe046-978b-4623-8e6d-0b359f3eb029 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.185411 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:46.222940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-0bd0d222-4328-4a64-a55f-9f0ce2ab81da req-18ebe046-978b-4623-8e6d-0b359f3eb029 service nova] Creating event network-changed:f5b17bbb-f70d-4036-a17a-05e70d05ead8 for instance be1b257c-d6c5-4686-96f2-73dfcb9516ef on hv-cinder-84713 Jun 24 10:16:46.244002 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-0bd0d222-4328-4a64-a55f-9f0ce2ab81da req-18ebe046-978b-4623-8e6d-0b359f3eb029 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130068 Jun 24 10:16:46.247121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 23/46] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:16:46.390661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:46.399029 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3be6bc03-571a-4aed-9fc1-67fc58945a46 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.381603 Jun 24 10:16:46.400591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 24/47] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:46 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:46.568665 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:46.572122 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:46.586799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.588063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.590195 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.592138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.716814 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:46.717648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:46.724058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:46.731343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.732279 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.735910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:46.736620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:46.828464 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:46.837800 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2e4ba12e-f889-4e78-bfc9-987cf58c4beb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.286925 Jun 24 10:16:46.846544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 24/48] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:46 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:47.004969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:47.023091 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:47.026595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:47.029311 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:47.030188 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:47.030991 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ef1cbd07-963a-4d9c-8d56-569e0793e1f4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.319032 Jun 24 10:16:47.031713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 25/49] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:46 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:47.051416 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:47.051866 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:47.059173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:47.059173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:47.295132 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:47.307363 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3aa4ca44-58b3-454d-80e6-54c80027d9b1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.282460 Jun 24 10:16:47.310011 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 25/50] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:47 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:47.421734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:47.423031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:47.431117 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:47.432619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:47.433852 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:47.435173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:47.631771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:47.641249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bd4c3ab5-ed87-4b96-aa4d-9a8a164d8910 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.223945 Jun 24 10:16:47.642651 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 26/51] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:47 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:47.864578 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:47.865926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:47.876545 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:47.878597 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:47.879591 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:47.880176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.051948 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:48.053248 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:48.060065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:48.060818 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.061776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:48.062392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.253485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:48.268632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-289085f8-bfed-4882-9a04-392a455510dc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.408630 Jun 24 10:16:48.271354 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 26/52] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:47 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:48.333548 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:48.334400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:48.341585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:48.342152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.343310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:48.343855 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.344631 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:48.378173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:48.379772 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:48.381340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-96333f7c-e924-40dd-a3c8-96e48a9f8122 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.333375 Jun 24 10:16:48.389580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 27/53] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:48 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:48.528156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:48.543455 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ce41160a-02ff-4cc3-aa92-cc697a9a969b tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.213901 Jun 24 10:16:48.546745 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 27/54] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:48 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:48.668338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:48.669118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:48.675960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:48.676487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.677438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:48.677873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:48.821116 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:48.830386 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0e9d4b01-48bc-43d4-84b2-9ea559bb8302 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.168630 Jun 24 10:16:48.831232 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 28/55] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:48 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:49.287621 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:49.288223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:49.300359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:49.301192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:49.302144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:49.302738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:49.409588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:49.410281 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:49.417105 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:49.417553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:49.418313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:49.418754 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:49.855635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:49.871378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-14be3a92-13df-4918-870a-49cf11330ff5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.579766 Jun 24 10:16:49.872073 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 28/56] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:49 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:49.886137 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:49.886651 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:49.898542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:49.899612 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:49.901024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:49.901588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:50.045435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:50.054381 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:50.056015 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:50.057325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9f8fe2f6-e8cb-4d92-ab5b-e9e97b924260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.651840 Jun 24 10:16:50.058402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 29/57] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:49 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:16:50.063079 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:50.064138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:50.070291 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:50.071055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:50.071989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:50.072565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:50.401775 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:50.409586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7ccbca82-0ad4-4653-a50c-d79505fb5925 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.527462 Jun 24 10:16:50.410183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 29/58] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:49 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:50.513656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:50.527099 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-12787475-6b0c-4717-95e2-da03a46ad290 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.467336 Jun 24 10:16:50.527702 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 30/59] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:50 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:50.889435 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:50.890216 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:50.904960 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:50.905323 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:50.906098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:50.906986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.078640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:51.080495 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:51.090002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:51.090829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.092468 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:51.093493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.352994 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:51.366753 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6aedcda7-e71c-4f29-8afd-cabc7f894fa2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.481114 Jun 24 10:16:51.368924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 30/60] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:50 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:51.382411 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:51.404438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:51.406086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:51.408344 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f9be7b03-e489-411b-b3f0-c11ce2881141 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.335984 Jun 24 10:16:51.408891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 31/61] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:51 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:51.428089 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:51.430043 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:51.437035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:51.437431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.438456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:51.438980 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.544812 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:51.545427 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:51.552225 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:51.554431 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.556339 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:51.557013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:51.602017 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:51.610957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f75e9119-2bf6-46ab-9e86-5956be3d68fe tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.186845 Jun 24 10:16:51.621238 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 31/62] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:51 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:51.710776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:51.719954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-89a32c93-90d8-41dc-af56-1efe0155cde4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.179033 Jun 24 10:16:51.720570 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 32/63] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:51 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:52.387363 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:52.388207 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:52.396157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.396880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.398133 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.399060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.431248 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:52.432094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:52.438293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:52.441815 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.442939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.443754 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.444234 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.687765 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:52.692554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:52.719866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:52.721349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:52.722460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-59665aef-2b6c-4749-9287-315c5b130abd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.299420 Jun 24 10:16:52.723417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-df634b20-c63d-4a08-a109-99be574a9112 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.333026 Jun 24 10:16:52.733761 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 32/64] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:52 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:52.738876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:52.739485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:52.743405 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 33/65] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:52 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:52.748470 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:52.751165 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:52.756054 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.760381 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.760895 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.761698 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.762143 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.770023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:52.770023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:52.770023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:53.019845 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:53.024304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:53.030507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5c7f4c24-d9c3-4072-9412-a8045d842986 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.295251 Jun 24 10:16:53.031245 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 33/66] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:52 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:53.034085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bda7e71d-fedc-473d-bd74-85dc907e5b19 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.289312 Jun 24 10:16:53.038254 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 34/67] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:52 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:53.744012 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:53.744792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:53.746937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:53.753404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:53.753943 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:53.754809 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:53.755458 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:53.762017 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:53.762642 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:53.769529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:53.769984 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:53.770851 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:53.771220 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:54.055585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:54.063542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-91e7b236-f75d-4f17-8421-a06c6ee56dbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.324621 Jun 24 10:16:54.073693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 34/68] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:53 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:54.077049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:54.098947 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:54.108997 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:54.111199 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:54.114096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:54.119977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3d389642-a6a0-4534-b9d5-2bc3381a1e64 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.361840 Jun 24 10:16:54.136928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:54.136928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:54.136928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:54.136928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:54.139124 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 35/69] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:53 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:54.145335 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:54.149587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:54.164065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:54.169239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:54.172831 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:54.177204 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:54.592782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:54.603446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-35a8e295-209b-4d36-93ab-54f3983e4375 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.462560 Jun 24 10:16:54.614011 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:54.617377 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 36/70] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:54 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:54.624053 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1c541dc8-abc9-4aad-83b6-f92e2f6b5f67 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.540006 Jun 24 10:16:54.625121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 35/71] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:54 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:55.093730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:55.095065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:55.103726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.104262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.105177 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.105723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.148453 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:55.151001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:55.163403 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.164107 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.165840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.166660 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.407175 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:55.418780 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-23d26a5c-8496-434f-8b2f-ac9bbd2a3e85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.330403 Jun 24 10:16:55.420882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 37/72] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:55 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:55.425664 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:55.440474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:55.443467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:55.445828 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a85ab335-3bc7-4ae1-a2dc-0d69f9ccc1dd tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.305314 Jun 24 10:16:55.447246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 36/73] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:55 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:16:55.620976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:55.621592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:55.628642 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.629096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.629862 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.630483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.656875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:55.658649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:55.672830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.674026 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.675609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:55.677149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:55.856305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:55.866573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-30258854-fe41-440d-b447-6b44990df8b3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.249857 Jun 24 10:16:55.868840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 38/74] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:55 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:55.906760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:55.919461 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5f3e4817-7d7b-4e57-bed8-055a185e3840 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.277757 Jun 24 10:16:55.920686 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 37/75] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:55 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:16:56.437103 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:56.438426 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:56.454170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.454170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.454587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.456373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.467034 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:56.467651 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:56.487738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.488185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.488975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.489407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.811882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:56.816739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:56.835200 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-81257b61-4f7f-4a1b-83f1-bb11838ff539 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.401322 Jun 24 10:16:56.836618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 39/76] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:56 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:56.891465 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:56.892815 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:56.897482 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:56.914232 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:56.916046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.916608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:56.916982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.918151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.918771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.919050 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1e259a7e-1a9b-40e3-8c5b-c453710feba3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.457836 Jun 24 10:16:56.920059 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 38/77] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:56 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:56.939169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:56.939955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:56.951899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.952717 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:56.953739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:56.955062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:57.306928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:57.318959 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a41411db-36c5-4745-9e7f-814fb99204be tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.384764 Jun 24 10:16:57.323005 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:57.323472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 39/78] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:56 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:57.337842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3ffb24f6-57a9-46e0-b703-d7062f21940d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.447633 Jun 24 10:16:57.342084 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 40/79] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:56 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:57.537533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-9927f20b-2a00-4dfa-903a-dcb1e81a7537 req-22a6553f-9ea5-4953-a259-2d27bd254f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "name": "network-vif-plugged", "status": "completed", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:57.551283 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-9927f20b-2a00-4dfa-903a-dcb1e81a7537 req-22a6553f-9ea5-4953-a259-2d27bd254f1c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:57.551894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-9927f20b-2a00-4dfa-903a-dcb1e81a7537 req-22a6553f-9ea5-4953-a259-2d27bd254f1c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:57.593421 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-9927f20b-2a00-4dfa-903a-dcb1e81a7537 req-22a6553f-9ea5-4953-a259-2d27bd254f1c service nova] Creating event network-vif-plugged:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:16:57.599662 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-9927f20b-2a00-4dfa-903a-dcb1e81a7537 req-22a6553f-9ea5-4953-a259-2d27bd254f1c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.274661 Jun 24 10:16:57.600706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 40/80] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:57.854964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:57.855588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:57.869353 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:57.871108 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:57.874053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:57.874590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:57.941976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:57.945579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:57.979520 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:57.983976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:57.987279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:58.008462 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:58.039268 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:16:58.347340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:58.377623 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8ec7f6b4-5baf-4178-8398-5fa16d270974 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.527207 Jun 24 10:16:58.379804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 41/81] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:57 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:58.385313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:58.386277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:58.393656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:58.394330 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:58.395714 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:58.396651 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:58.399923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:58.410359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:58.412442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:58.414130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c6e07109-6306-4356-a7b7-40d9928374b1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.477216 Jun 24 10:16:58.415154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 41/82] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:57 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:58.424753 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:58.426070 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:58.433682 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:58.434412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:58.435442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:58.436021 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:58.657300 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:58.672305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-49c628cb-0a58-471d-a8b8-929f53ff33dd tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.291210 Jun 24 10:16:58.678067 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 42/83] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:58 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:58.709012 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:58.717745 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f27cc81d-cd8a-44d8-9462-f3795740593c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.301161 Jun 24 10:16:58.718885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 42/84] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:58 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:59.397595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:59.398914 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:59.415019 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.416663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.418474 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.420616 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.433367 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:59.433988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:59.448407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.449497 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.450503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.451138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.724056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:59.741089 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1ff685fd-ce60-4258-93cf-cd242860b03b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.347867 Jun 24 10:16:59.742302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 43/85] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:59 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:16:59.748893 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:59.758241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33ad457-f04e-45ab-994a-de25ed757120", "name": "network-vif-plugged", "status": "completed", "tag": "90942a6e-0933-48c1-80c9-55ff402f0b93"}, {"server_uuid": "be1b257c-d6c5-4686-96f2-73dfcb9516ef", "name": "network-vif-plugged", "status": "completed", "tag": "f5b17bbb-f70d-4036-a17a-05e70d05ead8"}, {"server_uuid": "95be179c-5caf-487f-a710-6445f6163f51", "name": "network-vif-plugged", "status": "completed", "tag": "05874f33-e136-4a35-af2c-074f2098eaf9"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:16:59.761169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:59.762830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:16:59.764083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-955d2139-c3c0-40ef-aa0a-2d42a81646a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1407 microversion: 2.20 time: 0.335706 Jun 24 10:16:59.764705 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 43/86] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:16:59 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1407 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:16:59.776933 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:59.781880 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.782314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.787188 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:59.799892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.800713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] Creating event network-vif-plugged:90942a6e-0933-48c1-80c9-55ff402f0b93 for instance e33ad457-f04e-45ab-994a-de25ed757120 on hv-cinder-84713 Jun 24 10:16:59.801190 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.801315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] Creating event network-vif-plugged:f5b17bbb-f70d-4036-a17a-05e70d05ead8 for instance be1b257c-d6c5-4686-96f2-73dfcb9516ef on hv-cinder-84713 Jun 24 10:16:59.802011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] Creating event network-vif-plugged:05874f33-e136-4a35-af2c-074f2098eaf9 for instance 95be179c-5caf-487f-a710-6445f6163f51 on hv-cinder-84713 Jun 24 10:16:59.803282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.804341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.810328 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-78f4f11c-b181-480f-ac64-fea7ecd12c9a req-28eaf059-6385-4204-930f-9900017a73ce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.065949 Jun 24 10:16:59.810926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 44/87] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:16:59.816681 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:16:59.817404 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:16:59.823989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.824432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:16:59.825204 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:16:59.825622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:00.104162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:00.116808 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4d685f8b-9425-45de-ba6a-865d5b35428c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.350934 Jun 24 10:17:00.117532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 44/88] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:59 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:00.138050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:00.146345 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e83aef00-5146-4e2d-a6d2-bc86d9214609 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.334287 Jun 24 10:17:00.147140 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 45/89] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:16:59 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:00.758388 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:00.759148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:00.765952 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:00.771394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:00.772223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:00.772700 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:00.782667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:00.783280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:00.796812 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:00.798461 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:00.800439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:00.801784 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.249459 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:01.256780 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:01.256973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1db15462-8800-4dae-94d2-56fc7354adbe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.502539 Jun 24 10:17:01.257723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 45/90] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:00 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:01.267263 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:01.269348 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:01.270664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1bea8fb7-506f-45cb-9824-f9e61558d493 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1599 microversion: 2.20 time: 0.491862 Jun 24 10:17:01.270800 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:01.271269 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 46/91] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:17:00 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1599 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:17:01.271530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:01.277910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:01.278944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:01.281729 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.282258 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.283184 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.284047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.289402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.290646 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.291571 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.292003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.562102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:01.564961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:01.575886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8bc66ec5-0b6c-4cc8-9cb3-d58df3fe47f1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.302773 Jun 24 10:17:01.578767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e56939f6-3b2b-40ec-bf69-e422b511be94 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.319455 Jun 24 10:17:01.579903 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 46/92] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:01 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:01.586266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:01.587118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:01.587412 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 47/93] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:01 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:01.595389 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.595909 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.597186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.597734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.770136 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c6826c01-30b8-4af6-b414-4fad26720886 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.188758 Jun 24 10:17:01.771323 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 47/94] 10.222.0.64 () {60 vars in 1315 bytes} [Fri Jun 24 10:17:01 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-interface => generated 284 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:17:01.843735 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-4e09e11f-58fe-48f5-91c7-0e3a8ce6a7a9 req-a2ceaa0b-70bc-4098-93ab-3296a26a2fdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1", "name": "network-vif-plugged", "status": "completed", "tag": "c453626e-6db1-429e-a1a1-df11a4d87ee5"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:01.865023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-4e09e11f-58fe-48f5-91c7-0e3a8ce6a7a9 req-a2ceaa0b-70bc-4098-93ab-3296a26a2fdd service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:01.866120 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-4e09e11f-58fe-48f5-91c7-0e3a8ce6a7a9 req-a2ceaa0b-70bc-4098-93ab-3296a26a2fdd service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:01.892028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-4e09e11f-58fe-48f5-91c7-0e3a8ce6a7a9 req-a2ceaa0b-70bc-4098-93ab-3296a26a2fdd service nova] Creating event network-vif-plugged:c453626e-6db1-429e-a1a1-df11a4d87ee5 for instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 on hv-cinder-84713 Jun 24 10:17:01.902564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-4e09e11f-58fe-48f5-91c7-0e3a8ce6a7a9 req-a2ceaa0b-70bc-4098-93ab-3296a26a2fdd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068220 Jun 24 10:17:01.903878 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 48/95] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:02.275811 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:02.277249 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:02.294538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:02.295261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:02.303911 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:02.304549 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:02.545015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:02.556604 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-be5e225e-0443-4eda-9870-a76be2798271 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1321 microversion: 2.1 time: 0.286318 Jun 24 10:17:02.566119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 48/96] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:02 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:02.596745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:02.597776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:02.600169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:02.600817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:02.615142 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:02.615142 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:02.615341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:02.615627 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:02.649505 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:02.650491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.042s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:02.652097 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:02.652687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:03.182652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:03.196596 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f03d5c40-32d3-4b07-ae47-72a8fc7522ab tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1314 microversion: 2.1 time: 0.603105 Jun 24 10:17:03.198088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 49/97] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:02 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1314 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:03.216021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:03.232843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-51ed6520-6716-44bb-a2b7-7d1dfdeee515 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.641330 Jun 24 10:17:03.236847 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 49/98] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:02 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 647 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:03.574071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:03.574844 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:03.583254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:03.584392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:03.585821 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:03.586420 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:03.844239 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:03.854421 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0b127548-b796-4a62-8626-a34ca695b1b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1516 microversion: 2.1 time: 0.284544 Jun 24 10:17:03.856061 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 50/99] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:03 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1516 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:03.874892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:03.876743 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:03.893946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:03.894677 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:03.895563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:03.896035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:03.934756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-b821f4bc-7284-4b79-a456-bd2d50e258d6 req-ef7790e1-20a3-4370-bfb5-296a635b1708 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:03.951169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b821f4bc-7284-4b79-a456-bd2d50e258d6 req-ef7790e1-20a3-4370-bfb5-296a635b1708 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:03.954786 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b821f4bc-7284-4b79-a456-bd2d50e258d6 req-ef7790e1-20a3-4370-bfb5-296a635b1708 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:03.985354 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-b821f4bc-7284-4b79-a456-bd2d50e258d6 req-ef7790e1-20a3-4370-bfb5-296a635b1708 service nova] Creating event network-changed:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:17:03.997607 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-b821f4bc-7284-4b79-a456-bd2d50e258d6 req-ef7790e1-20a3-4370-bfb5-296a635b1708 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065152 Jun 24 10:17:03.998504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 51/100] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:17:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:17:04.020527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lazy-loading 'flavor' on Instance uuid be1b257c-d6c5-4686-96f2-73dfcb9516ef {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:17:04.191087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-825218d6-50a4-442e-abbf-5d3286739602 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef/action" status: 200 len: 32 microversion: 2.1 time: 0.321503 Jun 24 10:17:04.193994 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 50/101] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:17:03 2022] POST /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef/action => generated 32 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 10:17:04.204297 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:04.205097 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:04.214342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:04.215025 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:04.215900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:04.216021 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:04.217275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:04.217717 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:04.269301 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:04.270848 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:04.272412 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:04.273083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:04.491163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:04.504696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-24c347fa-85ea-446e-8f19-a771173927a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.305158 Jun 24 10:17:04.505264 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 52/102] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:04 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:04.511180 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:04.511989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:04.520718 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:04.521484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:04.522356 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:04.523291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:04.530169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:04.538118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0576781e-26a0-4a51-9005-57e5149c50d2 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1502 microversion: 2.1 time: 0.327300 Jun 24 10:17:04.539703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 51/103] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:04 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1502 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:04.694739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:04.709616 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-468b692c-31d9-4c31-ae71-49d1e19ec8d3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.203011 Jun 24 10:17:04.710131 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 53/104] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:04 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:05.522804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:05.523608 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:05.530963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:05.531529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:05.532568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:05.533037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:05.721523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:05.728339 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:05.730190 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:05.730563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-62250aba-132f-4443-b6f4-ccc6e78ba032 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.211885 Jun 24 10:17:05.731370 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 52/105] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:05 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:05.745610 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:05.746128 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:05.747163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:05.747657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:05.931324 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:05.940507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f3ba4d9b-9e9e-42f0-9958-6a5ef403157c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.217347 Jun 24 10:17:05.946743 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 54/106] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:05 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:06.748661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:06.749379 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:06.756725 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:06.757250 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:06.758972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:06.759427 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:06.902647 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:06.911211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-fc7951fd-d20e-4e88-aa00-2a81febe2a25 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.166619 Jun 24 10:17:06.911781 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 53/107] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:06 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:06.959992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:06.960607 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:06.967826 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:06.968275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:06.969048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:06.969484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:07.101372 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c21b5320-25ba-4729-8cef-09d2401ad926"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:07.102732 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:07.108903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:07.109342 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:07.110105 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:07.110534 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:07.115082 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:07.123159 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4ce9528f-17f9-481f-9c4f-b950a623d88b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.167198 Jun 24 10:17:07.123768 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 55/108] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:06 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:07.928693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:07.929279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:07.936324 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:07.936772 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:07.937538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:07.937973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:08.090950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:08.098961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-55ef3233-4076-41ae-bf87-ed82a588282b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.174116 Jun 24 10:17:08.099515 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 56/109] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:07 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:08.143343 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:08.143953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:08.151157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:08.151593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:08.152344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:08.152752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:08.302349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:08.310360 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-009445e5-1c60-4723-b56b-4ad0a5da4039 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.173371 Jun 24 10:17:08.310968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 57/110] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:08 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:09.118339 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:09.119367 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:09.126878 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:09.127390 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:09.128376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:09.128812 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:09.277758 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:09.281412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:09.286524 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8cc18695-5d54-4d5e-9152-dc691744ad06 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.172159 Jun 24 10:17:09.287231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 58/111] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:09 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:09.330340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:09.330979 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:09.337605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:09.338062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:09.338992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:09.339431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:09.489177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:09.498194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-060f0b77-dc99-4648-b555-7b19bd514f00 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.173568 Jun 24 10:17:09.498781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 59/112] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:09 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:10.310021 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:10.312007 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:10.320602 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:10.321406 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:10.323011 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:10.323872 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:10.394317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:10.417138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8cb66f6f-1b17-4968-9d30-63a0f2d566c5 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "POST /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.319527 Jun 24 10:17:10.417990 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 54/113] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:17:07 2022] POST /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120/os-volume_attachments => generated 194 bytes in 3321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:17:10.493034 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:10.500797 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2b94735a-5543-4737-ba33-14737217686b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.196956 Jun 24 10:17:10.501372 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 60/114] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:10 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:10.517532 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:10.518252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:10.524981 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:10.525415 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:10.526610 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:10.527155 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:10.681671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:10.696087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2ace26a0-2d75-47d0-9d98-4b4f6faf5cd2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1361 microversion: 2.1 time: 0.182099 Jun 24 10:17:10.696087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 55/115] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:10 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:11.523556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:11.525295 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:11.552764 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:11.553541 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:11.554550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:11.556254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:11.715917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:11.717564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:11.725471 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:11.726217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:11.726664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:11.727603 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:11.728196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:11.734251 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c83cccc7-22f4-4378-ac10-d4973227232c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.219638 Jun 24 10:17:11.735620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 61/116] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:11 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:11.878694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:11.887612 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-34b0a9b7-d4e2-4d32-980f-b451a0755ed3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1547 microversion: 2.1 time: 0.179570 Jun 24 10:17:11.888194 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 56/117] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:11 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1547 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:11.905183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:11.905689 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:11.912301 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:11.912746 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:11.913585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:11.914092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:11.996554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a2b404c7-a278-4e32-8b49-bbd2a92de6ea tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095718 Jun 24 10:17:11.997276 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 62/118] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:17:11 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:12.754148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:12.754924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:12.772877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:12.773456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:12.774468 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:12.775082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:13.264549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:13.273085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f833e0e4-f3f6-4c42-b87d-90f36cde4b03 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.524856 Jun 24 10:17:13.273661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 57/119] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:12 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:13.699827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-e2b1ff28-dbd0-4adc-851a-15e4ae46d30f req-54817aba-cfeb-4b9d-80fd-0ad0a6a18f08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1", "tag": "c453626e-6db1-429e-a1a1-df11a4d87ee5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:13.709081 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e2b1ff28-dbd0-4adc-851a-15e4ae46d30f req-54817aba-cfeb-4b9d-80fd-0ad0a6a18f08 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:13.710008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e2b1ff28-dbd0-4adc-851a-15e4ae46d30f req-54817aba-cfeb-4b9d-80fd-0ad0a6a18f08 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:13.726192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-e2b1ff28-dbd0-4adc-851a-15e4ae46d30f req-54817aba-cfeb-4b9d-80fd-0ad0a6a18f08 service nova] Creating event network-changed:c453626e-6db1-429e-a1a1-df11a4d87ee5 for instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 on hv-cinder-84713 Jun 24 10:17:13.732333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-e2b1ff28-dbd0-4adc-851a-15e4ae46d30f req-54817aba-cfeb-4b9d-80fd-0ad0a6a18f08 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039354 Jun 24 10:17:13.733286 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 63/120] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:14.289958 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:14.290867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:14.299793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:14.300261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:14.301577 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:14.302173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:14.473924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:14.484952 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-508ee304-7d2c-46ed-b005-c58d7e5194cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.199148 Jun 24 10:17:14.485893 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 58/121] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:14 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:15.512018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:15.513183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:15.528040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:15.529543 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:15.531958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:15.532606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:15.722035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:15.732048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7339c520-de52-43ef-ac9a-c25c9693186d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.230921 Jun 24 10:17:15.733244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 64/122] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:15 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:16.750237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:16.750951 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:16.758089 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:16.758679 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:16.759540 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:16.760035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:16.913795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:16.924314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e3fd5e3c-3e41-4a25-80de-12a011e9782c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.178697 Jun 24 10:17:16.924950 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 59/123] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:16 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:17.941487 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:17.942075 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:17.944139 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=84 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:17.950291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:17.950762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:17.951528 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:17.951959 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:18.110939 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:18.121096 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7bb6b46d-65c2-4980-adff-1ea5bea077be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.183475 Jun 24 10:17:18.121686 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 65/124] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:17 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:19.138498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:19.139125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:19.141568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=69 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:19.147114 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:19.147562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:19.148322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:19.148752 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:19.288504 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:19.297965 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ec451c5a-eedc-4aff-80f5-f749c4fa3430 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.163011 Jun 24 10:17:19.298725 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 60/125] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:19 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:20.316282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:20.316909 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:20.323402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:20.323857 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:20.324638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:20.325081 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:20.471342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:20.479634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-517e895d-a815-4e3c-9713-cb99133286a6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.166949 Jun 24 10:17:20.480220 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 66/126] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:20 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:21.497419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:21.498439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:21.505097 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:21.505527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:21.506300 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:21.506939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:21.660887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:21.669476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-29e448e7-8fe4-4103-9e31-427b4b292546 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.175967 Jun 24 10:17:21.670080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 61/127] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:21 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:22.710234 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:22.711851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:22.722253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:22.723181 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:22.724182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:22.724835 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:22.902858 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:22.913382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0930fc49-1106-4770-af00-915430e68ff4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.230587 Jun 24 10:17:22.914318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 67/128] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:22 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:23.376125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:23.376701 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:23.383897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:23.384313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:23.385364 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:23.385796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:23.430391 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:17:23.531152 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-09da02fd-8387-4d9d-b98f-77035998db74 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 204 len: 0 microversion: 2.1 time: 0.158466 Jun 24 10:17:23.532067 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 62/129] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:17:23 2022] DELETE /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:17:23.540808 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:23.541771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:23.548657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:23.549281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:23.549876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:23.550307 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:23.705700 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:23.714494 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c41b1c59-5608-4715-a38e-33666f5a0163 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1554 microversion: 2.1 time: 0.177738 Jun 24 10:17:23.715746 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 68/130] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:23 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:23.932056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:23.932635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:23.939203 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:23.939652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:23.940466 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:23.940922 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:24.093546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:24.102993 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4db0935e-031c-48e7-9da7-d37fe0e7ac1c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.175336 Jun 24 10:17:24.103775 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 63/131] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:23 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:24.733806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:24.734504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:24.741142 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:24.741576 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:24.742509 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:24.743105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:24.933192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:24.944016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-782a3a05-9e63-406b-a1e3-0dd345264898 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1554 microversion: 2.1 time: 0.213967 Jun 24 10:17:24.945492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 69/132] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:24 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:25.121766 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:25.122602 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:25.130581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:25.131131 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:25.131924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:25.132372 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:25.277793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:25.287537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-52995eee-2d90-4a9e-917c-a2a8e62e7c82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.170240 Jun 24 10:17:25.288394 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 64/133] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:25 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:25.971235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:25.971890 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:25.978740 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:25.979219 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:25.979970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:25.980398 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:26.179628 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:26.184452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-36400b03-22b0-43bf-9789-e5f5a5865c6c tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1554 microversion: 2.1 time: 0.217400 Jun 24 10:17:26.185038 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 70/134] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:25 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1554 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:26.314802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:26.317519 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:26.329480 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:26.330632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:26.332053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:26.332747 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:26.605267 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:26.614604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ff42e88e-d314-41d3-8dd1-3eb946cfc5cf tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.304211 Jun 24 10:17:26.615683 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 65/135] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:26 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:27.166631 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-a836fe9d-f456-48bf-b3e4-fec08efc3b4f req-76dcb53d-cfb6-4167-a6c9-147a9e503133 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e33ad457-f04e-45ab-994a-de25ed757120", "name": "network-vif-deleted", "tag": "90942a6e-0933-48c1-80c9-55ff402f0b93"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:27.202541 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:27.203338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:27.205583 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-a836fe9d-f456-48bf-b3e4-fec08efc3b4f req-76dcb53d-cfb6-4167-a6c9-147a9e503133 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:27.206028 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-a836fe9d-f456-48bf-b3e4-fec08efc3b4f req-76dcb53d-cfb6-4167-a6c9-147a9e503133 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:27.222928 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:27.224084 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:27.224935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:27.225371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:27.226969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-a836fe9d-f456-48bf-b3e4-fec08efc3b4f req-76dcb53d-cfb6-4167-a6c9-147a9e503133 service nova] Creating event network-vif-deleted:90942a6e-0933-48c1-80c9-55ff402f0b93 for instance e33ad457-f04e-45ab-994a-de25ed757120 on hv-cinder-84713 Jun 24 10:17:27.236976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-a836fe9d-f456-48bf-b3e4-fec08efc3b4f req-76dcb53d-cfb6-4167-a6c9-147a9e503133 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082990 Jun 24 10:17:27.238507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 71/136] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:17:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:27.322461 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fe9a62b8fcdc400b9ceb993bb8f936e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '54baeb39b08b4d69aac8c4d42043112a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:27.333473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f8c81cee-7de0-4b68-af29-ceb90b8aa2d1 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 200 len: 1345 microversion: 2.1 time: 0.135376 Jun 24 10:17:27.334073 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 66/137] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:27 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 1345 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:27.638941 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:27.639981 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:27.647439 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:27.648208 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:27.649737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:27.650471 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:27.900828 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:27.909553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fcc528a1-f81f-45a5-afc6-82aea576934d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.280513 Jun 24 10:17:27.910359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 72/138] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:27 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:28.351590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:28.352313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:28.360962 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:28.361426 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:28.362241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:28.362742 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:28.379428 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] HTTP exception thrown: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Request method failure captured: Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 HTTP/1.1 Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY74a6WIOmzhUnd000ylvHLuVSGvFZV62_rgrHKTUKPmSqzubJ9kqpKCYxL5OtmnR5tOGWoFDNSDIjZGLouCD5e02w2HIfVtJdmC-K9K31IirfkkhqJQC40a1LpXY2wAaj2xfmKLO8b8Pd5S-HIARUZvi4-PEkve4iOgf52d0PNXtH4 Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:17:28.384903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_54baeb39b08b4d69aac8c4d42043112a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}] Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: fe9a62b8fcdc400b9ceb993bb8f936e0 Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.386325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'e33ad457-f04e-45ab-994a-de25ed757120'} Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:28.387156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.388591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.390796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Returning 404 to user: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:28.391871 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-18e5b745-1aba-4932-b95e-cf4b7e4d92d9 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 404 len: 111 microversion: 2.1 time: 0.044827 Jun 24 10:17:28.398985 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 67/139] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:28 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:17:28.524456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:28.525386 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:28.535295 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:28.538990 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:28.539992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:28.541722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:28.560400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] HTTP exception thrown: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Request method failure captured: Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120/os-volume_attachments HTTP/1.1 Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY74a6WIOmzhUnd000ylvHLuVSGvFZV62_rgrHKTUKPmSqzubJ9kqpKCYxL5OtmnR5tOGWoFDNSDIjZGLouCD5e02w2HIfVtJdmC-K9K31IirfkkhqJQC40a1LpXY2wAaj2xfmKLO8b8Pd5S-HIARUZvi4-PEkve4iOgf52d0PNXtH4 Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:17:28.565679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_54baeb39b08b4d69aac8c4d42043112a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}] Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: fe9a62b8fcdc400b9ceb993bb8f936e0 Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.567475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'server_id': 'e33ad457-f04e-45ab-994a-de25ed757120'} Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:28.568187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:28.569244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:28.570277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Returning 404 to user: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:28.570277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8d31e6c3-160c-4a47-9a7d-c0c18b88db64 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.046944 Jun 24 10:17:28.570277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 73/140] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:17:28 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120/os-volume_attachments => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:17:28.927908 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:28.928682 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:28.935273 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:28.935726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:28.936486 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:28.936970 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:29.110909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:29.118885 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3e900b5f-a3e7-432f-8019-31f0c2a94479 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.195708 Jun 24 10:17:29.119504 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 68/141] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:28 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:29.788830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:29.789385 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:29.806851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:29.807843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:29.808629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:29.809054 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:29.828931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] HTTP exception thrown: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Request method failure captured: Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 HTTP/1.1 Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY74a6WIOmzhUnd000ylvHLuVSGvFZV62_rgrHKTUKPmSqzubJ9kqpKCYxL5OtmnR5tOGWoFDNSDIjZGLouCD5e02w2HIfVtJdmC-K9K31IirfkkhqJQC40a1LpXY2wAaj2xfmKLO8b8Pd5S-HIARUZvi4-PEkve4iOgf52d0PNXtH4 Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:17:29.832986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_54baeb39b08b4d69aac8c4d42043112a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}] Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: fe9a62b8fcdc400b9ceb993bb8f936e0 Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.834539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'e33ad457-f04e-45ab-994a-de25ed757120'} Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:29.835392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.836557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.839880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Returning 404 to user: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:29.841474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a4cd5cd1-3ae3-433c-b9c7-2547c8cbb60f tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 404 len: 111 microversion: 2.1 time: 0.056154 Jun 24 10:17:29.842684 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 74/142] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:17:29 2022] DELETE /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:17:29.851540 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:29.852179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] [instance: e33ad457-f04e-45ab-994a-de25ed757120] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:29.864613 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:29.865054 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:29.865825 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:29.866257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:29.884792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] HTTP exception thrown: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Request method failure captured: Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 HTTP/1.1 Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY74a6WIOmzhUnd000ylvHLuVSGvFZV62_rgrHKTUKPmSqzubJ9kqpKCYxL5OtmnR5tOGWoFDNSDIjZGLouCD5e02w2HIfVtJdmC-K9K31IirfkkhqJQC40a1LpXY2wAaj2xfmKLO8b8Pd5S-HIARUZvi4-PEkve4iOgf52d0PNXtH4 Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:17:29.886855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_54baeb39b08b4d69aac8c4d42043112a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/54baeb39b08b4d69aac8c4d42043112a"}]}] Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 54baeb39b08b4d69aac8c4d42043112a Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-DeleteServersTestJSON-1187438344 Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: fe9a62b8fcdc400b9ceb993bb8f936e0 Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-DeleteServersTestJSON-1187438344-project Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.888432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'e33ad457-f04e-45ab-994a-de25ed757120'} Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:29.889076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. Jun 24 10:17:29.896745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:17:29.898390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] Returning 404 to user: Instance e33ad457-f04e-45ab-994a-de25ed757120 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:29.898390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8d97c37e-b627-42ed-a488-70a5fd1d4865 tempest-DeleteServersTestJSON-1187438344 tempest-DeleteServersTestJSON-1187438344-project] 10.222.0.64 "GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120" status: 404 len: 111 microversion: 2.1 time: 0.041146 Jun 24 10:17:29.898390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 69/143] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:29 2022] GET /compute/v2.1/servers/e33ad457-f04e-45ab-994a-de25ed757120 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:17:30.136504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:30.137355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:30.143662 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:30.144164 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:30.145314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:30.146043 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:30.307668 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:30.316394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ca16dcb2-104d-421b-97fe-9f91e7e8e2fa tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.183647 Jun 24 10:17:30.317253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 75/144] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:30 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:31.336214 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:31.337670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:31.351420 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:31.352483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:31.353573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:31.354097 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:31.566120 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:31.572756 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:31.578623 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-54570901-c408-40db-bf1b-c6ea4d6d7a91 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.249072 Jun 24 10:17:31.579356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 70/145] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:31 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:32.599048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:32.600220 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:32.608182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:32.608805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:32.609706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:32.610257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:32.803919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:32.815680 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7125b821-f94d-44cc-a307-f91b18ac96ca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.222595 Jun 24 10:17:32.817003 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 76/146] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:32 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:33.834471 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:33.835245 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:33.847343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:33.847791 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:33.848782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:33.849406 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:34.034689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:34.043946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bde9e55b-fdea-4dfd-af4c-34d7361d2444 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.213010 Jun 24 10:17:34.044519 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 71/147] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:33 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:35.064589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:35.065192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:35.071896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:35.072287 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:35.073009 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:35.073451 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:35.229375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:35.241762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5e0161dd-77f3-41a5-834a-8a94ebea56be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.180991 Jun 24 10:17:35.242803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 77/148] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:35 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:35.354558 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1aca759c-ddc2-40ad-9522-a5938ddb651a tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Action: 'create', calling method: .version_select at 0x7f3775464940>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1704447952"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:35.680016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1aca759c-ddc2-40ad-9522-a5938ddb651a tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.464521 Jun 24 10:17:35.680949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 72/149] 10.222.0.64 () {60 vars in 1154 bytes} [Fri Jun 24 10:17:35 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 466 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 24 10:17:35.698732 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e322760a-8450-4913-b398-b7e52fed166f tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d96550>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:35.779547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e322760a-8450-4913-b398-b7e52fed166f tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 200 len: 345 microversion: 2.1 time: 0.090920 Jun 24 10:17:35.780092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 78/150] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:35 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 345 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:36.260179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:36.260781 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:36.270028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:36.270028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:36.270028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:36.270433 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:36.408744 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:36.417909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-33ccb18a-c9ed-4a07-8cc6-9df7e76c737a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.162106 Jun 24 10:17:36.418482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 73/151] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:36 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:36.792566 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6f63a288-8f4b-43b4-851e-ae552bf97d74 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d94310>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:36.845807 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6f63a288-8f4b-43b4-851e-ae552bf97d74 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 200 len: 345 microversion: 2.1 time: 0.057018 Jun 24 10:17:36.846650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 79/152] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:36 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:37.436861 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:37.437483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:37.444255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:37.444716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:37.445442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:37.445867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:37.593396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:37.601315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6528f48d-379a-41b5-bc82-83e9f69ce51d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.169225 Jun 24 10:17:37.601886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 74/153] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:37 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:37.858680 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ec37bf4a-b992-41fe-bdc1-ea655dfe2bd1 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7d310>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:37.912717 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ec37bf4a-b992-41fe-bdc1-ea655dfe2bd1 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 200 len: 345 microversion: 2.1 time: 0.058054 Jun 24 10:17:37.913282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 80/154] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:37 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 345 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:38.618299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:38.618925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:38.626256 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:38.626739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:38.627490 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:38.628269 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:38.792086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:38.799937 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-975e16ca-469a-40c9-92ac-eff885a7cf65 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.185749 Jun 24 10:17:38.800502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 75/155] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:38 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:38.927056 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-00fa2e53-ccff-4aa4-8622-b77be99d0448 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d94310>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:38.980490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-00fa2e53-ccff-4aa4-8622-b77be99d0448 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 200 len: 346 microversion: 2.1 time: 0.058536 Jun 24 10:17:38.981123 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 81/156] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:38 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 346 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:38.992222 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c662c8c2-090c-4117-b405-61abd0d0e41a tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Action: 'create', calling method: .version_select at 0x7f37755d3ca0>, body: {"snapshot": {"volume_id": "a439aaff-3d33-4744-b337-25c8401512a1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1960692418"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:39.163945 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c662c8c2-090c-4117-b405-61abd0d0e41a tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.175606 Jun 24 10:17:39.168956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 76/157] 10.222.0.64 () {60 vars in 1161 bytes} [Fri Jun 24 10:17:38 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:17:39.175230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-328fa731-58b8-4551-b990-a0a54aa4534b tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7d3a0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:39.208051 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-328fa731-58b8-4551-b990-a0a54aa4534b tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 287 microversion: 2.1 time: 0.036839 Jun 24 10:17:39.208633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 82/158] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:39 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:39.221526 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-21c466bf-187e-4249-99f3-99834143768c tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f377545d1f0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:39.252831 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-21c466bf-187e-4249-99f3-99834143768c tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.036007 Jun 24 10:17:39.253578 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 77/159] 10.222.0.64 () {58 vars in 1139 bytes} [Fri Jun 24 10:17:39 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:39.263808 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f0fe8cb1-6dc7-40a9-8f11-c530c4f0e5f1 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7daf0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:39.297538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f0fe8cb1-6dc7-40a9-8f11-c530c4f0e5f1 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 287 microversion: 2.1 time: 0.037147 Jun 24 10:17:39.298415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 83/160] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:39 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:39.818402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:39.820109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:39.828444 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:39.829674 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:39.830622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:39.831512 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:39.983734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:39.992104 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-682bae2a-c057-4222-aeb1-af018a04f5f0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.178804 Jun 24 10:17:39.992726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 78/161] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:39 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:40.309980 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0877a96c-97d8-4518-a571-9094d95d3b43 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7dca0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:40.341648 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0877a96c-97d8-4518-a571-9094d95d3b43 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 287 microversion: 2.1 time: 0.035166 Jun 24 10:17:40.342414 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 84/162] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:40 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:41.009877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:41.010496 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:41.017204 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:41.017657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:41.018427 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:41.018901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:41.198460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:41.205734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ea28984e-fc87-4d75-bbf7-043b588842d8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.199900 Jun 24 10:17:41.206644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 79/163] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:41 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:41.355607 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-89d4b673-8543-483d-9225-6ecbef94a552 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7d280>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:41.386479 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-89d4b673-8543-483d-9225-6ecbef94a552 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 287 microversion: 2.1 time: 0.034727 Jun 24 10:17:41.387192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 85/164] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:41 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:42.224675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:42.225396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:42.233954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:42.234779 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:42.235551 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:42.235982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:42.382320 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:42.390889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b74e1bfb-e9aa-44c2-81df-7fd674a659b2 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.170866 Jun 24 10:17:42.391467 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 80/165] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:42 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:42.406606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9cf13889-6016-4a11-b906-a9710ef8515f tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d969d0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:42.440335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9cf13889-6016-4a11-b906-a9710ef8515f tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 287 microversion: 2.1 time: 0.038639 Jun 24 10:17:42.442380 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 86/166] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:42 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:43.409789 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:43.410391 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:43.421404 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:43.423579 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:43.424616 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:43.425464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:43.456917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-dc9bfed1-f524-494d-a7d7-99a1eabde206 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d09280>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:43.516014 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-dc9bfed1-f524-494d-a7d7-99a1eabde206 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 288 microversion: 2.1 time: 0.065342 Jun 24 10:17:43.518952 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 87/167] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:43 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 288 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:17:43.530725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ebdc7557-70b5-4d33-b609-2af08ee1522c tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d94310>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:43.618227 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ebdc7557-70b5-4d33-b609-2af08ee1522c tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 202 len: 0 microversion: 2.1 time: 0.092047 Jun 24 10:17:43.618926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 88/168] 10.222.0.64 () {58 vars in 1253 bytes} [Fri Jun 24 10:17:43 2022] DELETE /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:17:43.627802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e33f30b0-5148-46c5-9f93-e00b2ac6383b tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7d550>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:43.659424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e33f30b0-5148-46c5-9f93-e00b2ac6383b tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 200 len: 287 microversion: 2.1 time: 0.035696 Jun 24 10:17:43.660255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 89/169] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:43 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:17:43.705639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:43.716315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-90598f25-8fbe-4ae0-adb2-90dca628c0ff tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.309941 Jun 24 10:17:43.717296 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 81/170] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:43 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:44.672741 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8ea4536-d12b-4dbe-ac3e-b3a60be50e02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d7d9d0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:44.722656 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-c8ea4536-d12b-4dbe-ac3e-b3a60be50e02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] HTTP exception thrown: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8ea4536-d12b-4dbe-ac3e-b3a60be50e02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Request method failure captured: Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 HTTP/1.1 Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY8_jXuLDNEWSe-jntQBWJgY2mkxZaldJjs2rlB1oiHHfZg3MYhcO1stDKFBTf-XcO8Ehwx2Muefi6T_d2hKIzq-XZ51GLDIzO19CHtgpvcZ4CCmO9EDbuethu2KAun6M37dUqOSjpkU3_C_lwhcbM-8uK1Jav11R_Tdk3wzrd4C0ds Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:17:44.726308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3d4512d231694fa187ada8905222baf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3d4512d231694fa187ada8905222baf7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}] Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 50944673799940368982b7c196eb65b3 Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'b88e4fa4-0e59-4f10-9073-de928f274cc7'} Jun 24 10:17:44.728047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. (HTTP 404) (Request-ID: req-8a69afe5-2b86-4d9f-81d9-005861d61a69) Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.728803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:17:44.732854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 24 10:17:44.734105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8ea4536-d12b-4dbe-ac3e-b3a60be50e02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Returning 404 to user: Snapshot b88e4fa4-0e59-4f10-9073-de928f274cc7 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:44.736100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c8ea4536-d12b-4dbe-ac3e-b3a60be50e02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7" status: 404 len: 111 microversion: 2.1 time: 0.059863 Jun 24 10:17:44.738499 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:44.738499 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:44.742009 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 90/171] 10.222.0.64 () {58 vars in 1250 bytes} [Fri Jun 24 10:17:44 2022] GET /compute/v2.1/os-snapshots/b88e4fa4-0e59-4f10-9073-de928f274cc7 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:17:44.748263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9a5d5acb-409c-4135-9609-40641f36f0df tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d09160>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:44.755533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:44.755971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:44.756753 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:44.757168 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:44.905091 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9a5d5acb-409c-4135-9609-40641f36f0df tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 202 len: 0 microversion: 2.1 time: 0.160998 Jun 24 10:17:44.905833 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 91/172] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:17:44 2022] DELETE /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:17:44.925392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9cc7f444-0006-4ed2-9f97-ab1d627592b7 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d09b80>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:45.010191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9cc7f444-0006-4ed2-9f97-ab1d627592b7 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 200 len: 345 microversion: 2.1 time: 0.098822 Jun 24 10:17:45.010963 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 92/173] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:44 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:45.030360 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:45.039006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-78e130e6-d542-42e7-876b-58a9c28aa375 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1522 microversion: 2.1 time: 0.305845 Jun 24 10:17:45.040253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 82/174] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:44 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1522 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:46.023213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b5f36277-e458-4d5c-be10-7a627d25e371 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774cd4280>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:46.032548 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=25 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:46.033632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=96 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:46.059221 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:46.060090 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:46.065567 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-b5f36277-e458-4d5c-be10-7a627d25e371 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] HTTP exception thrown: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b5f36277-e458-4d5c-be10-7a627d25e371 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Request method failure captured: Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 HTTP/1.1 Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY8_jXuLDNEWSe-jntQBWJgY2mkxZaldJjs2rlB1oiHHfZg3MYhcO1stDKFBTf-XcO8Ehwx2Muefi6T_d2hKIzq-XZ51GLDIzO19CHtgpvcZ4CCmO9EDbuethu2KAun6M37dUqOSjpkU3_C_lwhcbM-8uK1Jav11R_Tdk3wzrd4C0ds Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:17:46.069325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3d4512d231694fa187ada8905222baf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3d4512d231694fa187ada8905222baf7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}] Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 50944673799940368982b7c196eb65b3 Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'a439aaff-3d33-4744-b337-25c8401512a1'} Jun 24 10:17:46.070659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. (HTTP 404) (Request-ID: req-af99bf96-66e8-471b-9d05-c45147221a43) Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.071419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:17:46.072424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:17:46.074676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b5f36277-e458-4d5c-be10-7a627d25e371 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Returning 404 to user: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b5f36277-e458-4d5c-be10-7a627d25e371 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 404 len: 109 microversion: 2.1 time: 0.053021 Jun 24 10:17:46.076277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 93/175] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:46 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 109 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:17:46.081547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:46.081998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:46.082769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:46.083447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:46.084209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bac274ca-afc2-4f39-8ecb-be79f6cfbb35 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d09040>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:46.131041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-bac274ca-afc2-4f39-8ecb-be79f6cfbb35 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] HTTP exception thrown: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bac274ca-afc2-4f39-8ecb-be79f6cfbb35 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Request method failure captured: Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 HTTP/1.1 Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY8_jXuLDNEWSe-jntQBWJgY2mkxZaldJjs2rlB1oiHHfZg3MYhcO1stDKFBTf-XcO8Ehwx2Muefi6T_d2hKIzq-XZ51GLDIzO19CHtgpvcZ4CCmO9EDbuethu2KAun6M37dUqOSjpkU3_C_lwhcbM-8uK1Jav11R_Tdk3wzrd4C0ds Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:17:46.133185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3d4512d231694fa187ada8905222baf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3d4512d231694fa187ada8905222baf7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}] Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 50944673799940368982b7c196eb65b3 Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'a439aaff-3d33-4744-b337-25c8401512a1'} Jun 24 10:17:46.134423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. (HTTP 404) (Request-ID: req-cb31d2e3-1ae8-4c69-bb12-4c4c6108d238) Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.135168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:17:46.136501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:17:46.137507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bac274ca-afc2-4f39-8ecb-be79f6cfbb35 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Returning 404 to user: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-bac274ca-afc2-4f39-8ecb-be79f6cfbb35 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 404 len: 109 microversion: 2.1 time: 0.054902 Jun 24 10:17:46.138690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 94/176] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:17:46 2022] DELETE /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:17:46.149395 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-23f3bc88-82b7-47d4-b956-3af6b9e5ea02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Calling method '.version_select at 0x7f3774d09b80>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:46.183749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-23f3bc88-82b7-47d4-b956-3af6b9e5ea02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] HTTP exception thrown: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-23f3bc88-82b7-47d4-b956-3af6b9e5ea02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Request method failure captured: Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 HTTP/1.1 Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY8_jXuLDNEWSe-jntQBWJgY2mkxZaldJjs2rlB1oiHHfZg3MYhcO1stDKFBTf-XcO8Ehwx2Muefi6T_d2hKIzq-XZ51GLDIzO19CHtgpvcZ4CCmO9EDbuethu2KAun6M37dUqOSjpkU3_C_lwhcbM-8uK1Jav11R_Tdk3wzrd4C0ds Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:17:46.185936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3d4512d231694fa187ada8905222baf7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3d4512d231694fa187ada8905222baf7", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3d4512d231694fa187ada8905222baf7"}]}] Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 3d4512d231694fa187ada8905222baf7 Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-110682394 Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 50944673799940368982b7c196eb65b3 Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesSnapshotsTestJSON-110682394-project Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'a439aaff-3d33-4744-b337-25c8401512a1'} Jun 24 10:17:46.187402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. (HTTP 404) (Request-ID: req-1c1296bd-4389-4ece-9473-72ae21cd8c9d) Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.188353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:17:46.189605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:17:46.190851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-23f3bc88-82b7-47d4-b956-3af6b9e5ea02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] Returning 404 to user: Volume a439aaff-3d33-4744-b337-25c8401512a1 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-23f3bc88-82b7-47d4-b956-3af6b9e5ea02 tempest-VolumesSnapshotsTestJSON-110682394 tempest-VolumesSnapshotsTestJSON-110682394-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1" status: 404 len: 109 microversion: 2.1 time: 0.046797 Jun 24 10:17:46.192004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 95/177] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:46 2022] GET /compute/v2.1/os-volumes/a439aaff-3d33-4744-b337-25c8401512a1 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:17:46.256580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:46.264601 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b2f50ab1-463e-409b-a8b4-91e80598d9d4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1502 microversion: 2.1 time: 0.211674 Jun 24 10:17:46.265125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 83/178] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:46 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:17:46.280987 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:46.290542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:46.303671 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:46.304129 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:46.304972 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:46.305440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:46.460817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:46.470024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0e31f683-055b-4bac-a1d4-4f5266c15183 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1517 microversion: 2.1 time: 0.192775 Jun 24 10:17:46.470927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 96/179] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:46 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1517 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:47.917907 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:17:47.919011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:47.954371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:47.954847 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:47.955803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:47.956388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:47.990604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lazy-loading 'flavor' on Instance uuid 95be179c-5caf-487f-a710-6445f6163f51 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:17:48.087340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-08917c56-8d98-476d-a9a6-9fb275bfe7ec tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/action" status: 200 len: 32 microversion: 2.1 time: 0.173391 Jun 24 10:17:48.087961 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 84/180] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:17:47 2022] POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 24 10:17:48.102752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:48.104087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:48.111304 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:48.111751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:48.112554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:48.112981 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:48.294774 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:48.305149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7af1095a-fdae-420e-85ec-524e9db33ead tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.210132 Jun 24 10:17:48.306437 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 97/181] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:48 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:49.327174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:49.327866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:49.330015 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:49.336288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:49.336738 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:49.337531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:49.337970 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:49.480127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:49.489913 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e62c7bbc-ab09-4836-bd83-e0f620bdb425 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.167557 Jun 24 10:17:49.490467 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 85/182] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:49 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:50.145851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-cb7a9b80-1520-4d68-9309-c5550291b651 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3774cd40d0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:50.197698 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-cb7a9b80-1520-4d68-9309-c5550291b651 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/4239157b-4a90-422c-b04e-040a19955119" status: 200 len: 351 microversion: 2.1 time: 0.055821 Jun 24 10:17:50.198276 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 98/183] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:50 2022] GET /compute/v2.1/os-volumes/4239157b-4a90-422c-b04e-040a19955119 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:50.510577 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:50.511401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:50.520793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:50.521527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:50.523330 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:50.524238 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:50.696930 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:50.716050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e8c9aa30-4560-4337-a831-2eda2f1a3f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.211142 Jun 24 10:17:50.717984 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 86/184] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:50 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:51.735146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:51.735785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:51.742578 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:51.743066 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:51.743856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:51.744293 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:51.889415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:51.898028 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5587c9bf-7a40-4321-a376-e7560e74e0cc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.166806 Jun 24 10:17:51.898735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 99/185] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:51 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:52.688161 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3bdbc15a-5d9b-4ab1-94f4-12023f503987 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3775464670>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:52.739983 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3bdbc15a-5d9b-4ab1-94f4-12023f503987 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/0eb464ae-dc7d-4196-be75-53af454bf533" status: 200 len: 351 microversion: 2.1 time: 0.055639 Jun 24 10:17:52.740598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 87/186] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:52 2022] GET /compute/v2.1/os-volumes/0eb464ae-dc7d-4196-be75-53af454bf533 => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:52.915624 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:52.916482 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:52.924583 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:52.925762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:52.927002 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:52.928368 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:53.075869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:53.089573 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ccfa1e5d-9641-4948-8cf8-9280b4cff6fe tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.178078 Jun 24 10:17:53.090223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 100/187] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:52 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:54.103142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-60b9c941-5d84-4b9c-b6d1-d318934db34b tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3775470550>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.108426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.109223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:54.117519 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:54.118208 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:54.119640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:54.120167 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:54.157968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-60b9c941-5d84-4b9c-b6d1-d318934db34b tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/fd36f136-7095-4dcf-b5e7-19b1d67bbdac" status: 200 len: 351 microversion: 2.1 time: 0.060227 Jun 24 10:17:54.158544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 88/188] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes/fd36f136-7095-4dcf-b5e7-19b1d67bbdac => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:54.169716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0efa15ff-a953-4c5c-9c01-d6328062e371 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f37755aa700>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.255020 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0efa15ff-a953-4c5c-9c01-d6328062e371 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.088889 Jun 24 10:17:54.255887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 89/189] 10.222.0.64 () {58 vars in 1133 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:54.271360 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-42bfc34d-d40c-4792-a1e2-c23bd2299bb7 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3775557f70>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.276256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:54.285064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-84bd8bc7-e98b-495e-a6fb-80bbb2d8a38b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.180933 Jun 24 10:17:54.287099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 101/190] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:54.358762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-42bfc34d-d40c-4792-a1e2-c23bd2299bb7 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.091940 Jun 24 10:17:54.360652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 90/191] 10.222.0.64 () {58 vars in 1148 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:54.371972 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-11046cd4-7446-4308-87d1-07d9110296e2 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3774cd4af0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.458438 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-11046cd4-7446-4308-87d1-07d9110296e2 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.089988 Jun 24 10:17:54.459041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 102/192] 10.222.0.64 () {58 vars in 1133 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:54.472800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c5f594ad-d9bc-4250-8fd6-d445c924cdc4 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f377547aca0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.556835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c5f594ad-d9bc-4250-8fd6-d445c924cdc4 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088603 Jun 24 10:17:54.557399 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 91/193] 10.222.0.64 () {58 vars in 1166 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:54.581061 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7817add9-ee4d-4964-8726-4d9a5b0c97fa tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3774d7ddc0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.668933 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7817add9-ee4d-4964-8726-4d9a5b0c97fa tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.101979 Jun 24 10:17:54.669102 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 103/194] 10.222.0.64 () {58 vars in 1169 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:17:54.682305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5fe91c7e-ef5c-4a96-8bd8-a0f2cf80af0d tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3775464940>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.771847 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5fe91c7e-ef5c-4a96-8bd8-a0f2cf80af0d tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.093878 Jun 24 10:17:54.772435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 92/195] 10.222.0.64 () {58 vars in 1154 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:54.785794 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9e353b56-8c38-49f3-aa33-d9c385ec3797 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3774d09ca0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.874310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9e353b56-8c38-49f3-aa33-d9c385ec3797 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.093836 Jun 24 10:17:54.874918 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 104/196] 10.222.0.64 () {58 vars in 1187 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:17:54.887542 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8f9526a1-c03d-4b4a-9cf8-15758f7e4c30 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] Calling method '.version_select at 0x7f3775464a60>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:54.979681 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8f9526a1-c03d-4b4a-9cf8-15758f7e4c30 tempest-VolumesTestJSON-1914873625 tempest-VolumesTestJSON-1914873625-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.096185 Jun 24 10:17:54.980543 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 93/197] 10.222.0.64 () {58 vars in 1154 bytes} [Fri Jun 24 10:17:54 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:55.302517 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:55.303211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:55.310064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:55.310489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:55.311274 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:55.311700 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:55.443331 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:55.451281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-991a5c07-4896-4f05-97e4-66802e1d34bc tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.152700 Jun 24 10:17:55.451843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 105/198] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:55 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:56.469354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:56.470080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:56.476702 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:56.477250 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:56.478022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:56.478463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:56.621722 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:56.632148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8d4c7f1e-cfa3-46d1-9905-c4470775b243 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.167442 Jun 24 10:17:56.632795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 94/199] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:56 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:57.653130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:57.654234 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:57.661920 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:57.662447 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:57.663265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:57.665349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:57.842289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:57.850425 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4e668b3a-9bea-4c2a-b984-7bede196c0b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.202655 Jun 24 10:17:57.851049 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 106/200] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:57 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:17:58.867932 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:17:58.868573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:17:58.876266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:58.876694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:58.877533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:17:58.877941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:17:58.897550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:17:59.085548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:17:59.098204 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a2c1246f-703b-492c-9033-a253b7cdf81a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.234051 Jun 24 10:17:59.099679 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 95/201] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:17:58 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:00.118166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:00.119840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:00.125468 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:00.125891 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:00.126919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:00.127353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:00.310825 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:00.330424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-95e3046f-ef5b-4977-8533-53edcaf11e5c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.215360 Jun 24 10:18:00.341290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 107/202] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:00 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:01.347989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:01.348596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:01.356259 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:01.356615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:01.357422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:01.358059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:01.512573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:01.521041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3d05adc0-cab3-4277-95fd-9e4ca5beacd8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.176870 Jun 24 10:18:01.521970 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 96/203] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:01 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:02.538798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:02.540082 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:02.547118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:02.547641 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:02.548485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:02.548935 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:02.697575 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:02.710182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fe4e7ff2-773e-4b5a-8f6d-8a80f94b4046 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.175758 Jun 24 10:18:02.711940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 108/204] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:02 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:03.728375 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:03.729278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:03.736591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:03.737159 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:03.738388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:03.738928 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:03.903379 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:03.918439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-56092c03-a004-4e99-a941-aa5ac51924a8 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.193946 Jun 24 10:18:03.919265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 97/205] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:03 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:04.936561 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:04.937137 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:04.943441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:04.943892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:04.944649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:04.945081 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.080170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:05.088250 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-95753357-6f4b-4b23-bd8d-4fc3c117038c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1503 microversion: 2.1 time: 0.155753 Jun 24 10:18:05.088790 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 109/206] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:04 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:05.105876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5e9b3823-8f0a-4828-b34f-1affc4c7bf81"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:05.106943 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:05.116995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:05.116995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.116995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:05.116995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.140522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] HTTP exception thrown: Cannot 'attach_volume' instance 95be179c-5caf-487f-a710-6445f6163f51 while it is in vm_state rescued Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Request method failure captured: Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/os-volume_attachments HTTP/1.1 Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 74 Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY744HRlPwP1EIqX0GnCPfWiw1q2DHeFzAttpSa3JDrD9vQCDI08IByFUd2W_kKKI3BrhLnEkXaQWNYhq-0Kmbp8gShZJztR5orPAhaHKtC7j6GN3pxS4zg4V79aNjZwRpLSZEK-WaPohZHtTHB87W2BhfrBjbj3UUTOUqMU6S7cVLg Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:18:05.142762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_172381cd65a94b1fa2939d6af673f6ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}] Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: acbafaab99f848828c304ca5a45a55dc Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {"volumeAttachment": {"volumeId": "5e9b3823-8f0a-4828-b34f-1affc4c7bf81"}} Jun 24 10:18:05.144239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Cannot 'attach_volume' instance 95be179c-5caf-487f-a710-6445f6163f51 while it is in vm_state rescued Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'server_id': '95be179c-5caf-487f-a710-6445f6163f51', 'body': {'volumeAttachment': {'volumeId': '5e9b3823-8f0a-4828-b34f-1affc4c7bf81'}}} Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 95be179c-5caf-487f-a710-6445f6163f51 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:18:05.145002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 95be179c-5caf-487f-a710-6445f6163f51 while it is in vm_state rescued Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:18:05.146144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 95be179c-5caf-487f-a710-6445f6163f51 while it is in vm_state rescued Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Returning 409 to user: Cannot 'attach_volume' instance 95be179c-5caf-487f-a710-6445f6163f51 while it is in vm_state rescued {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7355fd4e-9e6e-48e9-b053-a3d9fe4047eb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042637 Jun 24 10:18:05.147188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 98/207] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:18:05 2022] POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/os-volume_attachments => generated 152 bytes in 44 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:18:05.153814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:05.154347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:05.160739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:05.161256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.161971 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:05.162368 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.247024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-535031f1-9e77-4ac5-8b01-d59de1959bbd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/action" status: 202 len: 0 microversion: 2.1 time: 0.097085 Jun 24 10:18:05.250907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 110/208] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:18:05 2022] POST /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:18:05.256282 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:05.256895 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:05.263555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:05.264023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.264794 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:05.265231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:05.455922 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:05.464735 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-39f46c4e-02e6-40f2-a180-a0c688d57ba6 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1511 microversion: 2.1 time: 0.212386 Jun 24 10:18:05.466670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 99/209] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:05 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1511 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:06.487877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:06.491982 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:06.509745 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:06.510214 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:06.512139 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:06.512590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:06.762652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:06.771406 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c2a01c62-ade4-42f7-91bc-5da6fba62f55 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1511 microversion: 2.1 time: 0.291156 Jun 24 10:18:06.772415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 111/210] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:06 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1511 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:07.789253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:07.790413 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:07.802203 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:07.802661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:07.803491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:07.803929 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:08.075700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:08.085914 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0080e6ab-4ad4-4c2a-9f1e-efa45d56afca tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1511 microversion: 2.1 time: 0.300390 Jun 24 10:18:08.086871 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 100/211] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:07 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1511 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:09.107469 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:09.108931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:09.127928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:09.128770 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:09.129977 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:09.130775 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:09.297630 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:09.306573 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c8552910-eb87-47a5-8530-b198f90b9232 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1517 microversion: 2.1 time: 0.204819 Jun 24 10:18:09.307433 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 112/212] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:09 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1517 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:10.769241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b36ceb31-7b2b-41f0-856d-07e4597cdb5b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'create', calling method: .version_select at 0x7f3775464a60>, body: {"keypair": {"name": "tempest-keypair-2109712094", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC8yTS+mdimtZ5Beja61rUjP9H1PNWbRSM31+Eb5vmAG3xbY9aELQGA9NuQMA4GBWTyTR+3pi0QOVc/UonVDQxtqp4sUyxibtkISgYNTyXiu4YfqLtf1aLDFKe31HSZV1Q=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:10.788811 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-b36ceb31-7b2b-41f0-856d-07e4597cdb5b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:18:10.793165 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-b36ceb31-7b2b-41f0-856d-07e4597cdb5b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for user acbafaab99f848828c304ca5a45a55dc and project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:18:10.830050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b36ceb31-7b2b-41f0-856d-07e4597cdb5b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.064589 Jun 24 10:18:10.830920 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 101/213] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:18:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:12.514744 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-393212359", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d20895ef-2afb-4e4b-a39f-18a1a6f9b4f5"}], "security_groups": [{"name": "tempest-securitygroup--2041606093"}], "key_name": "tempest-keypair-2109712094", "user_data": "}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:12.615444 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:12.616019 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:12.623779 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:12.624238 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:12.625021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:12.625493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:12.628267 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] validate_networks() for [('d20895ef-2afb-4e4b-a39f-18a1a6f9b4f5', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:18:12.649997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5bea292f-026b-4f58-bca1-d08a85055134 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/ips" status: 200 len: 152 microversion: 2.20 time: 0.039166 Jun 24 10:18:12.650578 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 102/214] 10.222.0.64 () {60 vars in 1288 bytes} [Fri Jun 24 10:18:12 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:18:13.037509 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:18:13.037999 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:18:13.038465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:18:13.038948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:18:13.039351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:18:13.049338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:13.049969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:13.050763 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:13.051194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:13.070041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:18:13.075369 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Getting quotas for user acbafaab99f848828c304ca5a45a55dc and project 172381cd65a94b1fa2939d6af673f6ba. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:18:13.086696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:18:13.089567 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:18:13.139693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b97c5b6d-269c-48d3-a863-b2f4d8289628 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.629308 Jun 24 10:18:13.140359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 113/215] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:18:12 2022] POST /compute/v2.1/servers => generated 409 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:18:13.150493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-24a8164b-559a-4262-b9e5-a62d74a85082 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:13.151123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-24a8164b-559a-4262-b9e5-a62d74a85082 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:13.206178 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-24a8164b-559a-4262-b9e5-a62d74a85082 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:13.214487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-24a8164b-559a-4262-b9e5-a62d74a85082 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1245 microversion: 2.1 time: 0.067698 Jun 24 10:18:13.215119 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 103/216] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:13 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1245 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:14.231749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:14.232319 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:14.238510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:14.239198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:14.240110 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:14.240696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:14.304460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:14.312689 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-91380958-cee5-4520-9700-4ce1bab6fba4 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1241 microversion: 2.1 time: 0.085012 Jun 24 10:18:14.313279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 114/217] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:14 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:15.329809 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:15.331181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:15.339250 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:15.339783 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:15.341102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:15.341824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:15.410012 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:15.420752 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5e4e1d21-83fb-4826-90f5-31149ce390a3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1303 microversion: 2.1 time: 0.094960 Jun 24 10:18:15.425162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 104/218] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:15 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1303 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:15.673921 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:15.675416 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:15.685717 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:15.686291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:15.687088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:15.687522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:15.724338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lazy-loading 'flavor' on Instance uuid cb96a476-856a-400c-8c57-30b98297ebee {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:18:15.783534 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:16.051085 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-98f31a92-fb70-4cf0-9d72-3e8dc73eb45e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/action" status: 202 len: 0 microversion: 2.20 time: 0.380826 Jun 24 10:18:16.051721 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 115/219] 10.222.0.64 () {62 vars in 1318 bytes} [Fri Jun 24 10:18:15 2022] POST /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:18:16.060551 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:16.061160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:16.067335 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:16.067976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:16.068750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:16.069240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:16.208331 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:16.218690 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:16.220209 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:16.221401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e4dd01be-c676-4337-a14a-52b0c69ec8fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.165316 Jun 24 10:18:16.222090 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 105/220] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:16 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:16.438037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:16.438764 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:16.440803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:16.446555 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:16.447027 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:16.447798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:16.448233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:16.598848 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:16.609041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1fa86c6b-ea31-4fc9-8e78-ce1f9b305a17 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.175047 Jun 24 10:18:16.609715 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 116/221] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:16 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:17.240108 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:17.240682 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:17.248389 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:17.248824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:17.249751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:17.250332 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:17.561963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:17.570448 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:17.581035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:17.582475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-cc1a5505-6f82-4100-9144-096e2d846c97 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.346349 Jun 24 10:18:17.595381 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 106/222] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:17 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:17.628924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:17.630735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:17.638991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:17.639624 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:17.640544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:17.641125 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:17.792616 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-62a8b615-07bc-4a33-8c62-8655b0751183 req-65bc5e7d-b0a1-41a5-9507-fb763d6382e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89570c7f-aa48-4b00-8f01-4db37fae4d62", "tag": "68d3c446-3f13-44e3-a64e-32cfa07544ad"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:17.802585 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-62a8b615-07bc-4a33-8c62-8655b0751183 req-65bc5e7d-b0a1-41a5-9507-fb763d6382e3 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:17.803075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-62a8b615-07bc-4a33-8c62-8655b0751183 req-65bc5e7d-b0a1-41a5-9507-fb763d6382e3 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:17.822818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:17.827076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-62a8b615-07bc-4a33-8c62-8655b0751183 req-65bc5e7d-b0a1-41a5-9507-fb763d6382e3 service nova] Creating event network-changed:68d3c446-3f13-44e3-a64e-32cfa07544ad for instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 on hv-cinder-84713 Jun 24 10:18:17.833033 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-89e1dfc7-16f0-4b37-a7fa-deccdcdf8b46 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.209314 Jun 24 10:18:17.834383 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 117/223] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:17 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:17.838232 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-62a8b615-07bc-4a33-8c62-8655b0751183 req-65bc5e7d-b0a1-41a5-9507-fb763d6382e3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049555 Jun 24 10:18:17.838816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 107/224] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:18:18.505463 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:18.505954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:18.512335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:18.513024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:18.513838 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:18.514279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:18.539167 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-330e2f33-dec9-4407-abde-322754e24508 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/ips" status: 200 len: 145 microversion: 2.1 time: 0.037410 Jun 24 10:18:18.540232 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 118/225] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:18:18 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/ips => generated 145 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:18.604563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:18.606102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:18.612963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:18.613544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:18.614529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:18.615052 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:18.851486 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:18.852113 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:18.859472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:18.859915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:18.860676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:18.861102 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:19.066637 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:19.073683 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:19.077481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:19.079162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:19.080401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-867fc588-ee7e-467b-b609-be38b06620e3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.481948 Jun 24 10:18:19.081163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 108/226] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:18 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:19.081738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-dd2b1d6d-fdc4-4abd-9855-7ed80fb18cd3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.233989 Jun 24 10:18:19.082275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 119/227] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:18 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:20.103067 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:20.103842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:20.103995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:20.104929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:20.111962 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:20.112663 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:20.113086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:20.113974 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:20.114655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:20.115035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:20.116136 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:20.118246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:20.119615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:20.356546 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:20.358450 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:20.365366 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:20.367090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:20.367399 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-41b339ae-3c78-4f10-a62a-345dabe4e69b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.270188 Jun 24 10:18:20.368538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8e6e5a77-24a5-4820-8a53-23e6a4d5e6bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.269938 Jun 24 10:18:20.369573 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 120/228] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:20 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:20.370465 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 109/229] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:20 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:21.390959 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:21.391579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:21.395610 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:21.396227 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:21.403350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:21.403803 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:21.404579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:21.405004 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:21.408872 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:21.409325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:21.410133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:21.410570 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:21.627162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:21.635420 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:21.635777 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d178e76e-d91d-4374-8788-d79b8d2920a9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.253025 Jun 24 10:18:21.636643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 121/230] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:21 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:21.642006 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da7f66de-aadb-439e-8f0d-83cd7d6c7670"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:21.643600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:21.651081 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:21.651563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:21.653029 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:21.653472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:21.655223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:21.656763 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:21.659581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2e63f0b3-6f73-49a2-9742-2f759bfa3e91 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.275869 Jun 24 10:18:21.660366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 110/231] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:21 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:22.652935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:22.653819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:22.660490 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:22.660843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:22.661741 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:22.662177 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:22.819588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:22.827240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-cc6e1aab-310f-4c55-9a37-553bcab60e07 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.178401 Jun 24 10:18:22.827938 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 111/232] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:22 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:22.836161 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:22.836161 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:22.845751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:22.846202 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:22.847042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:22.847477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:22.990511 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:23.000045 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:23.001911 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:23.003101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ec5bff6d-b010-4c80-a873-a6c2bec67694 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.174376 Jun 24 10:18:23.003652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 112/233] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:22 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:23.059188 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:23.082015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=6 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:23.844753 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:23.845251 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:23.847063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:23.853003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:23.853457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:23.854224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:23.854764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:23.998112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:24.008780 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a1de115f-fbc9-4b01-bef9-3e43e4508598 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.167924 Jun 24 10:18:24.009572 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 113/234] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:23 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:24.022003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:24.022680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:24.029903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:24.030445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:24.034280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:24.034755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:24.172700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:24.181476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:24.183364 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:24.184551 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c69e08b8-efe9-42cc-adc7-e4f113fb408a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.166701 Jun 24 10:18:24.185095 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 114/235] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:24 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:24.489948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8f260957-0fa4-458b-babc-6e917263da9f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.851741 Jun 24 10:18:24.490751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 122/236] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:18:21 2022] POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-volume_attachments => generated 194 bytes in 2853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:24.515614 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-d3c1652f-0597-4a78-a109-21817784ff9a req-6ae6921d-d3f1-4183-8b97-a458c1d81ab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89570c7f-aa48-4b00-8f01-4db37fae4d62", "name": "network-vif-plugged", "status": "completed", "tag": "68d3c446-3f13-44e3-a64e-32cfa07544ad"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:24.531636 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-d3c1652f-0597-4a78-a109-21817784ff9a req-6ae6921d-d3f1-4183-8b97-a458c1d81ab6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:24.532074 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-d3c1652f-0597-4a78-a109-21817784ff9a req-6ae6921d-d3f1-4183-8b97-a458c1d81ab6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:24.551557 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-d3c1652f-0597-4a78-a109-21817784ff9a req-6ae6921d-d3f1-4183-8b97-a458c1d81ab6 service nova] Creating event network-vif-plugged:68d3c446-3f13-44e3-a64e-32cfa07544ad for instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 on hv-cinder-84713 Jun 24 10:18:24.558873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-d3c1652f-0597-4a78-a109-21817784ff9a req-6ae6921d-d3f1-4183-8b97-a458c1d81ab6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047130 Jun 24 10:18:24.560896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 115/237] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:25.034640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:25.035466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:25.050966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:25.050966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:25.050966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:25.050966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:25.195880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:25.204000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a752d92d-db8f-4ff1-92ac-bbd890c3d0d3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.173948 Jun 24 10:18:25.204242 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:25.204707 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 123/238] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:25 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:25.204941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:25.211459 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:25.211914 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:25.212687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:25.213123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:25.217871 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:25.352491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:25.362063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:25.363354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:25.364550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4751e73e-a221-4339-a656-a1fb4789d587 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.165032 Jun 24 10:18:25.365256 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 116/239] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:25 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:26.223434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:26.224196 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:26.231005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:26.231895 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:26.232773 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:26.233275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:26.388755 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:26.394834 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:26.396280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:26.398390 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-13ecd372-b2a7-4547-8a87-6a9e8cbc336b tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1371 microversion: 2.1 time: 0.179466 Jun 24 10:18:26.399341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 124/240] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:26 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1371 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:26.404246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:26.405075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:26.406209 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:26.406833 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:26.577434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:26.591131 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:26.597495 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:26.598812 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-612cb989-bbd8-4d86-8b69-308937fbfe8b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.215173 Jun 24 10:18:26.599425 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 117/241] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:26 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:27.417659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:27.418461 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:27.430265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.431166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.432577 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.433345 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.591569 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:27.599478 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-12841453-d1c7-4708-b338-b98305e94c70 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1565 microversion: 2.1 time: 0.186646 Jun 24 10:18:27.600067 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 125/242] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:27 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1565 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:27.618488 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:27.619566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:27.621874 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:27.622615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:27.628461 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.629187 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.630071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.630304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.630723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.631071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.631729 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:27.632259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:27.753891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-724be130-7a68-46e4-90f5-979207f58209 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.141732 Jun 24 10:18:27.754920 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 118/243] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:18:27 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:27.832707 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:27.842291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:27.844015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:27.845222 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e04b32f1-93f8-4057-8f15-a0be8c435356 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.229355 Jun 24 10:18:27.845773 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 126/244] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:27 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:28.758249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-0c2706cc-5d6e-435f-931e-d619bdd2b52e req-7805100c-1cd5-4e93-a850-7e85cd11570c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89570c7f-aa48-4b00-8f01-4db37fae4d62", "tag": "68d3c446-3f13-44e3-a64e-32cfa07544ad"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:28.766864 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-0c2706cc-5d6e-435f-931e-d619bdd2b52e req-7805100c-1cd5-4e93-a850-7e85cd11570c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:28.767304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-0c2706cc-5d6e-435f-931e-d619bdd2b52e req-7805100c-1cd5-4e93-a850-7e85cd11570c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:28.779622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-0c2706cc-5d6e-435f-931e-d619bdd2b52e req-7805100c-1cd5-4e93-a850-7e85cd11570c service nova] Creating event network-changed:68d3c446-3f13-44e3-a64e-32cfa07544ad for instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 on hv-cinder-84713 Jun 24 10:18:28.785792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-0c2706cc-5d6e-435f-931e-d619bdd2b52e req-7805100c-1cd5-4e93-a850-7e85cd11570c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031575 Jun 24 10:18:28.786828 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 119/245] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:28.865434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:28.867033 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:28.873690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:28.874138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:28.874922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:28.875359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:29.007899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:29.016879 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:29.018374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:29.019598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-47ae4246-fdf0-4b4f-b81b-142e52503036 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.158188 Jun 24 10:18:29.020170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 127/246] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:28 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:30.040797 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:30.041795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:30.049113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:30.049902 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:30.050858 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:30.052674 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:30.193994 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:30.202274 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:30.203811 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:30.204983 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-44e95d6a-9f41-4fe7-8458-6baeb681a152 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.169975 Jun 24 10:18:30.205550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 120/247] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:30 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:18:31.224253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:31.224948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:31.234867 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:31.235309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:31.236055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:31.236471 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:31.381378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:31.391493 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:31.392968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:31.394107 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5ce2115b-ec5a-4d83-abc9-3f407bbaac43 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.173846 Jun 24 10:18:31.394666 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 128/248] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:31 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:32.412229 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:32.412899 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:32.419774 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:32.420219 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:32.420988 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:32.421422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:32.558673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:32.567085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:32.568571 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:32.569745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-35d7ae9a-110c-45d3-963c-948071374885 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.161480 Jun 24 10:18:32.570325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 121/249] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:32 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:33.588853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:33.590378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:33.597123 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:33.597572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:33.598344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:33.598816 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:33.735588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:33.739159 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:33.744173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:33.746130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:33.747397 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-abf2be1e-6bb4-4792-8cf0-bea8e890ced4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.162671 Jun 24 10:18:33.747958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 129/250] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:33 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:34.768597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:34.769387 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:34.779362 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:34.779973 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:34.781005 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:34.781611 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:34.922566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:34.930733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:34.932247 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:34.933517 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f20b0c30-f615-4290-a133-c1aabc2a04e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.170625 Jun 24 10:18:34.934103 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 122/251] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:34 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:35.957365 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:35.958318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:35.968538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:35.968929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:35.969666 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:35.970094 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:36.109245 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:36.117528 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:36.119065 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:36.120306 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d2f0e026-dbf9-427c-8106-30935c02f81a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.170247 Jun 24 10:18:36.120858 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 130/252] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:35 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:37.143826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:37.144795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:37.154839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:37.155283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:37.156278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:37.156546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:37.291046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:37.300058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:37.301700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:37.303126 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-09f964e4-777e-496f-a61c-a244341bd37b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.165866 Jun 24 10:18:37.303679 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 123/253] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:37 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:38.322072 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:38.326550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:38.329785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:38.330232 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:38.331044 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:38.331449 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:38.468637 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:38.476949 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:38.478432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:38.479992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0d8b80e8-d9d7-4c4f-a9c3-58910a9c7b25 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.161715 Jun 24 10:18:38.480605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 131/254] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:38 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:39.503839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:39.504446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:39.511635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:39.512115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:39.512884 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:39.513294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:39.648396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:39.657115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:39.658575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:39.659766 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1ef262ac-01b0-44e3-8529-8f11e933dadc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.160174 Jun 24 10:18:39.660288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 124/255] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:39 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:40.684209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:40.684831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:40.691917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:40.692365 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:40.693138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:40.693572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:40.833948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:40.844540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:40.846032 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:40.847233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2b4ac144-8553-40f8-81c5-fbbc89b9c4c7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.167063 Jun 24 10:18:40.847801 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 132/256] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:40 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:41.866032 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:41.866648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:41.873628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:41.874081 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:41.874866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:41.875309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:42.010061 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:42.018918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:42.020476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:42.021628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-25d7b926-1f73-47f7-9817-24a6279cdf15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.159760 Jun 24 10:18:42.022187 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 125/257] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:41 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:43.040125 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:43.040734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:43.047745 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:43.048183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:43.048971 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:43.049396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:43.192741 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:43.201856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:43.203377 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:43.204529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e79ba986-d1af-48c8-a8c0-43d244d94179 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1745 microversion: 2.20 time: 0.168427 Jun 24 10:18:43.205096 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 133/258] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:43 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1745 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:43.792521 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a171c4ff-18dd-4f38-96d0-a1f2be0640f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:43.802640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a171c4ff-18dd-4f38-96d0-a1f2be0640f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:43.803471 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a171c4ff-18dd-4f38-96d0-a1f2be0640f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:43.922162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a171c4ff-18dd-4f38-96d0-a1f2be0640f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Going to try to stop instance {{(pid=117855) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 10:18:43.977757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a171c4ff-18dd-4f38-96d0-a1f2be0640f4 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.192365 Jun 24 10:18:43.978747 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 126/259] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:18:43 2022] POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:18:44.006936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:44.008470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:44.032793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:44.035520 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:44.038100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:44.039139 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:44.210490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:44.221283 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-346f8fb6-616e-4439-9944-c877806ef593 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.236679 Jun 24 10:18:44.222078 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 134/260] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:43 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:44.225210 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:44.226130 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:44.233282 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:44.233734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:44.234572 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:44.235196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:44.443906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:44.454641 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:44.456325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:44.458046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3a7de54e-48dc-4886-8812-ba8b591ebba6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1745 microversion: 2.20 time: 0.238677 Jun 24 10:18:44.458986 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 127/261] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:44 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1745 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:18:44.625357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-a0a4af03-740d-4e9d-ad2b-1aee7b220dfd req-dac5e2f2-f51e-4e84-ae60-e687ff73b71e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "name": "network-vif-plugged", "status": "completed", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:44.633347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-a0a4af03-740d-4e9d-ad2b-1aee7b220dfd req-dac5e2f2-f51e-4e84-ae60-e687ff73b71e service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:44.633781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-a0a4af03-740d-4e9d-ad2b-1aee7b220dfd req-dac5e2f2-f51e-4e84-ae60-e687ff73b71e service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:44.645878 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-a0a4af03-740d-4e9d-ad2b-1aee7b220dfd req-dac5e2f2-f51e-4e84-ae60-e687ff73b71e service nova] Creating event network-vif-plugged:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:18:44.651531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-a0a4af03-740d-4e9d-ad2b-1aee7b220dfd req-dac5e2f2-f51e-4e84-ae60-e687ff73b71e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030305 Jun 24 10:18:44.652443 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 135/262] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:45.239324 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:45.240986 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:45.249110 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:45.249471 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:45.250237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:45.250663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:45.402294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:45.411403 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-12dcc5f5-9ddf-4325-81fd-cc33b29c3f79 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.175937 Jun 24 10:18:45.412006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 128/263] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:45 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:45.480078 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:45.480901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:45.491448 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:45.492298 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:45.493296 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:45.493937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:45.643041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:45.651538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:45.653136 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:45.654320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4de8575c-c4f0-4a83-848a-1a5fb51eb4df tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1745 microversion: 2.20 time: 0.179169 Jun 24 10:18:45.654896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 136/264] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:45 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1745 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:46.430782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:46.432224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:46.440497 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:46.442356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:46.443516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:46.444229 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:46.629896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:46.642307 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5da33960-2f6c-40dd-a2cb-b84a12592960 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.215302 Jun 24 10:18:46.643404 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 129/265] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:46 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:46.672520 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:46.673291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:46.676726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=42 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:46.682450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:46.682927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:46.683928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:46.684525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:46.870078 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:46.879417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:46.880804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:46.882013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6573d521-6656-42a6-bc53-7df7b1b79c92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.213558 Jun 24 10:18:46.882572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 137/266] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:46 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:47.662796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:47.665980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:47.709027 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:47.711873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:47.714231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:47.715548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:47.907616 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:47.908962 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:47.920969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:47.923088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:47.928009 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:47.928681 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:48.085512 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:48.104329 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a89f41f7-310a-4502-a255-36c914ea79ab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.447940 Jun 24 10:18:48.105247 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 130/267] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:47 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:48.286558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:48.301922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:48.303467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:48.304633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ea699201-8436-4d54-aa57-89d3a2546720 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.404355 Jun 24 10:18:48.307818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 138/268] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:47 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:18:49.121561 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:49.122178 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:49.132473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:49.133234 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:49.137792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:49.138455 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:49.323650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:49.324264 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:49.336560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:49.343038 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:49.346979 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:49.359384 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:49.579104 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:49.596595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5da2ef6c-73e1-4ea0-86a8-c8d282711e84 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.479076 Jun 24 10:18:49.622426 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 131/269] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:49 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:49.900966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:49.912345 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:49.922370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:49.924558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-67feb68b-9d11-4c96-8a1b-b0a08ab0df23 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.604052 Jun 24 10:18:49.940121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 139/270] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:49 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:18:50.617152 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:50.618069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:50.626876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=46 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.629073 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:50.629706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:50.640730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:50.641716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:50.950262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:50.954275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:50.956045 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:50.957130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:50.968787 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-cfb5eaa5-8760-410b-af42-b50e6076b962 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.354494 Jun 24 10:18:50.971049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 132/271] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:50 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:51.006371 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:51.007046 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:51.008335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:51.011619 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:51.827374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:51.841773 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:51.844019 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:51.846920 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4fc10733-380a-474e-9a0c-0f2dbc81488e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.896213 Jun 24 10:18:51.849416 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 140/272] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:50 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:18:51.891637 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-962852296", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:51.958876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] validate_networks() for None {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:18:51.999446 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:52.007196 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:52.034043 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:52.035175 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:52.037381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:52.039909 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:52.790010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:52.805754 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ed1f5f72-3fbf-4465-83e8-a09526a1b25f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.814695 Jun 24 10:18:52.819510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 141/273] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:51 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:52.867899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:52.868864 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:52.878010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:52.885553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:52.886557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:52.887306 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:52.961686 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:18:52.962363 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:18:52.962564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:18:52.963301 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:18:52.963789 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:18:52.982631 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:52.988816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:52.992768 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:52.993494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:53.053078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Getting quotas for project f68ef0ce863f43cdab4afcba5329f925. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:18:53.076420 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Getting quotas for user d25025d4a28e451fb4e60b5a1e97ce4c and project f68ef0ce863f43cdab4afcba5329f925. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:18:53.107654 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:18:53.114860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:18:53.264917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-fd62b691-b1c5-4bff-bddd-53c2bf75ef2f tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.377381 Jun 24 10:18:53.265463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 133/274] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:18:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1379 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:18:53.284795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-39e2ccc4-8255-445f-b700-866670f97008 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:53.306936 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-39e2ccc4-8255-445f-b700-866670f97008 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:53.341613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:53.354430 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:53.368001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:53.371456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-98874975-2d7c-4ce0-a848-aaeeffb3dd1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.506320 Jun 24 10:18:53.373165 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 142/275] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:52 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:53.437963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-39e2ccc4-8255-445f-b700-866670f97008 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:53.455414 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-39e2ccc4-8255-445f-b700-866670f97008 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1214 microversion: 2.1 time: 0.181295 Jun 24 10:18:53.456747 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 134/276] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:53 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1214 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:53.832401 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:53.833995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:53.845752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:53.853702 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:53.855609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:53.857836 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:54.243990 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:54.260410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-38808c07-092c-4faa-8188-f13aaeba38c8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.433438 Jun 24 10:18:54.261957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 143/277] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:53 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:54.393144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:54.394935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:54.413751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:54.423102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:54.423951 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:54.424383 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:54.480206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:54.481968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:54.509573 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:54.510357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:54.511329 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:54.511794 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:54.707374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:54.725222 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3e2e2017-924b-4f64-a9f7-e2751d642401 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1210 microversion: 2.1 time: 0.255700 Jun 24 10:18:54.735644 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 144/278] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:54 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1210 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:54.747577 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:54.760174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:54.763342 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:54.764585 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-03067683-2741-46f2-9bdd-fa3194233301 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.375906 Jun 24 10:18:54.777567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 135/279] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:54 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:55.289098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:55.289863 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:55.299040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:55.304984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:55.306419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:55.307118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:55.607267 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:55.617877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4893b47f-d777-4bae-b109-ed114cf8cb61 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.333033 Jun 24 10:18:55.623501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 145/280] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:55 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:55.744391 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1519559957", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "networks": [{"uuid": "68ae0d24-43c3-4ab7-b393-8a1204423670"}]}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:55.745662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:55.747216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:55.760858 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:55.761568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:55.763912 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:55.764523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:55.839257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] validate_networks() for [('68ae0d24-43c3-4ab7-b393-8a1204423670', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:18:55.965531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:55.973314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b28b5071-80c1-4898-bd1a-969f468c4730 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1272 microversion: 2.1 time: 0.234381 Jun 24 10:18:55.984150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 136/281] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:55 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1272 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:55.989503 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:55.990544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:56.008550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:56.010609 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:56.011620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:56.015216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:56.379106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:56.388942 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:56.390460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:56.391720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f0907ba4-c3f5-4819-ab30-f73de8cbf1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.406219 Jun 24 10:18:56.392297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 137/282] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:55 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:56.491092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:18:56.491784 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:18:56.492519 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:18:56.493163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:18:56.493840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:18:56.511506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:56.512552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:56.513606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:56.514119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:56.536673 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Getting quotas for project 4a8a290c7de54fb892f408f3d4f1e657. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:18:56.541951 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Getting quotas for user 516e13cf120a461d8632844453635fa9 and project 4a8a290c7de54fb892f408f3d4f1e657. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:18:56.562344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:18:56.568410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:18:56.641008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:56.641625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:56.655616 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:56.656393 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:56.658155 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:56.659358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:56.660820 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-43d4f20f-08f8-4d66-b575-8c52a1fbea21 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.919961 Jun 24 10:18:56.661924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 146/283] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:18:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 922 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:18:56.683384 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e4bf9b8d-dc5f-43c4-9eac-cabc3bb207e5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:56.684241 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e4bf9b8d-dc5f-43c4-9eac-cabc3bb207e5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:56.859883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e4bf9b8d-dc5f-43c4-9eac-cabc3bb207e5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:56.872787 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e4bf9b8d-dc5f-43c4-9eac-cabc3bb207e5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1214 microversion: 2.1 time: 0.197313 Jun 24 10:18:56.883489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 147/284] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:56 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1214 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:56.992826 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:56.994182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:57.015351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:57.017399 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:57.018434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:57.020905 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:57.070383 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:57.096699 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4514b7bc-1a73-4b2e-8be1-ba5e420baad9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.456056 Jun 24 10:18:57.098118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 138/285] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:56 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:57.183940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:57.194510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:18:57.198569 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e41fb577-9877-4d46-bc6d-13e2fda58c72 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1272 microversion: 2.1 time: 0.210726 Jun 24 10:18:57.206742 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 148/286] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:56 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1272 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:57.413184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:57.414288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:57.446919 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:57.447410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:57.448197 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:57.448906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:57.867518 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:57.878820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:57.896055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:57.897826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:57.899996 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c90eb815-f36b-4c5c-a2ce-f884f5b1c581 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.493090 Jun 24 10:18:57.900831 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 139/287] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:57 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:57.903256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:57.945617 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:57.946558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:57.952335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:57.953841 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:58.049035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:58.058590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b0180234-85df-4ec0-b838-e7a426c74bc1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1266 microversion: 2.1 time: 0.170593 Jun 24 10:18:58.060577 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 149/288] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:57 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:58.118257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:58.118940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:58.134917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:58.135379 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:58.140166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:58.140612 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:58.218996 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:58.219916 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:58.247204 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:58.247594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:58.248379 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:58.248821 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:58.630613 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:58.645598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-616cd6c4-049c-46c7-a718-fb1acbcaf707 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.529292 Jun 24 10:18:58.646596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 140/289] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:58 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:18:58.720817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:58.735035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c52c7803-cc2c-4662-96ac-de39183431a4 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.522300 Jun 24 10:18:58.738092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 150/290] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:58 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:58.919805 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:58.920436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:58.938833 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:58.939482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:58.940299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:58.942669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.078044 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:59.080908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:59.097134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.102212 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.106040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.106878 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.461882 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:59.477109 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9358b7b2-06de-4cd2-9ac4-653ce2066ea0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1272 microversion: 2.1 time: 0.400021 Jun 24 10:18:59.478054 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 151/291] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:59 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1272 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:18:59.597242 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:59.608170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:59.609950 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:18:59.612125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-55967a56-3d63-4a5c-873e-f7f472422e1f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.697141 Jun 24 10:18:59.627179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 141/292] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:18:58 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:18:59.664108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:59.665986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:59.677305 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.681632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.682825 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.688158 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.716137 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-e240365a-4764-42db-abad-169865ea3d74 req-aae13cd5-9fc2-4891-b8e8-5f860a9645fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a74b8896-2818-4dd1-881b-20ce731e056b", "tag": "ca85e86d-1048-417d-a0c6-a127ef4567db"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:18:59.750625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e240365a-4764-42db-abad-169865ea3d74 req-aae13cd5-9fc2-4891-b8e8-5f860a9645fe service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.759664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-e240365a-4764-42db-abad-169865ea3d74 req-aae13cd5-9fc2-4891-b8e8-5f860a9645fe service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.788740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-e240365a-4764-42db-abad-169865ea3d74 req-aae13cd5-9fc2-4891-b8e8-5f860a9645fe service nova] Creating event network-changed:ca85e86d-1048-417d-a0c6-a127ef4567db for instance a74b8896-2818-4dd1-881b-20ce731e056b on hv-cinder-84713 Jun 24 10:18:59.798839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-e240365a-4764-42db-abad-169865ea3d74 req-aae13cd5-9fc2-4891-b8e8-5f860a9645fe service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087001 Jun 24 10:18:59.799816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 142/293] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:18:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:18:59.805931 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:18:59.806987 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:18:59.814057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.814872 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:18:59.816013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:18:59.816587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:00.344852 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:00.367305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-92ae544e-303b-4435-b72d-7ff49f8c5c9b tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.565344 Jun 24 10:19:00.367887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 143/294] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:59 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:00.401633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:00.415305 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0a4246cc-8582-4a27-a958-b9520e8437c1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.755044 Jun 24 10:19:00.416656 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 152/295] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:18:59 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 757 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:00.495446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:00.497511 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:00.512342 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:00.515652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:00.519130 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:00.522089 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:00.632629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:00.633239 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:00.650569 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:00.651055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:00.651852 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:00.652293 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:01.103405 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:01.120509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1f26c476-7d47-4111-9f64-44636f123309 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.629586 Jun 24 10:19:01.133283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 144/296] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:00 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:01.174205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:01.198814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:01.202246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:01.204381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2fdbb3e5-11b8-4efd-a72c-26bdae800928 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.577399 Jun 24 10:19:01.206090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 153/297] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:00 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:01.386382 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:01.387236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:01.398218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:01.398997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:01.401190 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:01.415320 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:01.436122 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:01.436922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:01.462188 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:01.462963 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:01.464116 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:01.465115 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:01.968209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:01.982647 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0ea64e12-10c3-4d4f-ab84-6c9c69161b5f tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.550716 Jun 24 10:19:01.998174 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 154/298] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:01 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:02.055735 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:02.072742 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bd3cf13e-81f2-47b3-9843-d0cf661ef0bb tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.690871 Jun 24 10:19:02.080705 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 145/299] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:01 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:02.138691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:02.139338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:02.156051 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:02.156512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:02.157393 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:02.157832 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:02.223750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:02.224930 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:02.235718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:02.241632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:02.245176 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:02.249336 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:03.022410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:03.036161 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:03.045125 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-08d19d0d-796c-47f8-b5d7-4527fe475303 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.910283 Jun 24 10:19:03.050526 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:03.054849 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 155/300] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:02 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:03.076598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:03.079351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:03.079955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-e2b46625-dcc3-4b08-932d-af91a5f2eaa0 req-42def6b4-6b4d-497f-86e0-a247d478121b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33", "tag": "c6a205fe-bd8f-48c8-90b0-9153f04e0de5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:03.086629 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6b103527-f498-4119-8310-775e656fb345 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.865535 Jun 24 10:19:03.099597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 146/301] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:02 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:03.105930 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:03.107470 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:03.112426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e2b46625-dcc3-4b08-932d-af91a5f2eaa0 req-42def6b4-6b4d-497f-86e0-a247d478121b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:03.112880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e2b46625-dcc3-4b08-932d-af91a5f2eaa0 req-42def6b4-6b4d-497f-86e0-a247d478121b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:03.123191 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:03.123642 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:03.130867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:03.131410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:03.153718 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-e2b46625-dcc3-4b08-932d-af91a5f2eaa0 req-42def6b4-6b4d-497f-86e0-a247d478121b service nova] Creating event network-changed:c6a205fe-bd8f-48c8-90b0-9153f04e0de5 for instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 on hv-cinder-84713 Jun 24 10:19:03.171350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-e2b46625-dcc3-4b08-932d-af91a5f2eaa0 req-42def6b4-6b4d-497f-86e0-a247d478121b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115103 Jun 24 10:19:03.171994 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 156/302] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:03.197767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:03.205153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:03.211983 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:03.223792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:03.225430 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:03.226320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:03.454907 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=8 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:03.559117 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:03.573860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0a94a933-99dd-47a2-96c3-63b9fc4c5368 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.475526 Jun 24 10:19:03.574969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 147/303] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:03 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:03.601074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:03.611128 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-431fc380-a847-46f0-a17e-2c036312c791 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.429185 Jun 24 10:19:03.612289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 157/304] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:03 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:04.072960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:04.073563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:04.095131 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.095836 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.096956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.097541 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.108347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:04.109529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:04.118457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.120973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.122048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.126294 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.357239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:04.368193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3ee4ab23-3c48-4f4a-bc3e-01a5078fea49 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.300820 Jun 24 10:19:04.369640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 148/305] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:04 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:04.462764 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:04.477445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:04.479258 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:04.484008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-12533d51-cdf7-4b98-8829-72464f9bafec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.380616 Jun 24 10:19:04.489383 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 158/306] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:04 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:04.594034 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:04.594662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:04.605662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.606041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.606872 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.607320 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.629412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:04.630186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:04.640233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.642217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:04.643180 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:04.646267 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:05.078172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:05.091686 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-289cdf65-6fd3-49ca-8dc1-4253b10c17e1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.503253 Jun 24 10:19:05.092461 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 149/307] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:04 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:05.125450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:05.142761 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-27b59dbb-53ba-4fbe-8f89-96b69f5ffae9 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.510651 Jun 24 10:19:05.144016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 159/308] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:04 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:05.385478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:05.386489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:05.395044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:05.395835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:05.396954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:05.397604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:05.515189 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:05.516411 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:05.533440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:05.540224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:05.541299 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:05.541930 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:05.586687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:05.598134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2cd84891-6bf9-4835-9d65-113f0c8763e9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.216663 Jun 24 10:19:05.601775 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 150/309] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:05 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:05.891017 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:05.900336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:05.909444 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:05.910677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-57225f7d-0b56-4aee-8fb0-f2c3214fbc78 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.400206 Jun 24 10:19:05.922355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 160/310] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:05 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:06.110216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:06.111030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:06.118570 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.119525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.120569 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.121460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.160558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:06.163889 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:06.179329 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.179909 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.184877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.185327 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.455302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:06.461734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.470730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a005bdf0-5449-4fa2-9e83-281c6f64b645 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.364766 Jun 24 10:19:06.472502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 151/311] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:06 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:06.524048 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.547373 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:06.557272 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ab9580d4-25d8-496e-819a-045ddc0a7165 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.401392 Jun 24 10:19:06.557857 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 161/312] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:06 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:06.615202 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:06.616591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:06.624618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.625425 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.626376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.626989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.844066 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:06.853836 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b277f74d-fb7e-41bb-bd30-770b7bfb4c93 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.242237 Jun 24 10:19:06.863775 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 152/313] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:06 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:06.942896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:06.943723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:06.953627 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=8 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:06.955485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.955904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:06.956689 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:06.961550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.349370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:07.357941 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:07.365160 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:07.368708 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-03655dc2-c35d-4e79-b681-68535a899b45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.428784 Jun 24 10:19:07.370156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 162/314] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:06 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:07.488962 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:07.489698 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:07.501943 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.502522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.506268 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.506912 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.573565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:07.574731 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:07.584671 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.587992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.588969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.589396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.832382 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:07.844940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-433b2354-fbaf-47d5-8734-56949143faa8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.357970 Jun 24 10:19:07.858416 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 153/315] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:07 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:07.864630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-f4de6abc-b4e9-44b3-b396-4d4ea9e57c9a req-83a90432-949a-4693-b3dc-a0da2e27a960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74b8896-2818-4dd1-881b-20ce731e056b", "name": "network-vif-plugged", "status": "completed", "tag": "ca85e86d-1048-417d-a0c6-a127ef4567db"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:07.888893 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f4de6abc-b4e9-44b3-b396-4d4ea9e57c9a req-83a90432-949a-4693-b3dc-a0da2e27a960 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.889598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f4de6abc-b4e9-44b3-b396-4d4ea9e57c9a req-83a90432-949a-4693-b3dc-a0da2e27a960 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.898112 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:07.906195 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0cce4a81-2043-4189-bc53-514dfa2829be tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.336290 Jun 24 10:19:07.906975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 163/316] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:07 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:07.907637 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-f4de6abc-b4e9-44b3-b396-4d4ea9e57c9a req-83a90432-949a-4693-b3dc-a0da2e27a960 service nova] Creating event network-vif-plugged:ca85e86d-1048-417d-a0c6-a127ef4567db for instance a74b8896-2818-4dd1-881b-20ce731e056b on hv-cinder-84713 Jun 24 10:19:07.920520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-f4de6abc-b4e9-44b3-b396-4d4ea9e57c9a req-83a90432-949a-4693-b3dc-a0da2e27a960 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053454 Jun 24 10:19:07.920520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 154/317] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:07.920703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:07.920703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:07.931028 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.931488 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:07.932646 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:07.933311 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.185098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:08.201681 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f72243ea-de60-4530-a58b-6f30163713f2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.293801 Jun 24 10:19:08.202290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 164/318] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:07 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:08.328055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a8e43265-5456-4cdb-ab3c-8cc0132f52bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Action: 'create', calling method: .version_select at 0x7f3774bd49d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2005574597", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM7wfhTBiUAYPg5L8/eszzOWj/nxVfLAcFLJbxivJ4+JzP4tVaC1ZetLmuW41tPeCTi1yUPy6bBq2pZY9Wi3rrANPSvSJ4omIWiC8cj0U/4tpp8VF+glhNBTdfNWvqx3ng=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:08.347196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-a8e43265-5456-4cdb-ab3c-8cc0132f52bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Getting quotas for project 90f6878fdaaf43b58b92bea357331d2e. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:19:08.354215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-a8e43265-5456-4cdb-ab3c-8cc0132f52bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Getting quotas for user 23c7ecdb284d4ad0bda072a87ad8984c and project 90f6878fdaaf43b58b92bea357331d2e. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:19:08.379464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a8e43265-5456-4cdb-ab3c-8cc0132f52bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.457627 Jun 24 10:19:08.380408 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 155/319] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:19:07 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:08.389278 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:08.389912 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:08.396663 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:08.397055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.398160 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:08.398910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.646605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:08.656986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:08.659654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:08.661776 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-414d193c-038a-49ce-92c6-9fc1cb2fe4e5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1740 microversion: 2.20 time: 0.276001 Jun 24 10:19:08.668623 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 165/320] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:08 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:08.863226 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:08.864069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:08.871701 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:08.872352 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.873174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:08.873830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.923289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:08.924369 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:08.942016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:08.942451 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.946156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:08.948863 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:08.959508 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:09.071384 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:09.085367 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-dd388e20-62e0-429d-a387-ebc121b1d624 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.226127 Jun 24 10:19:09.086851 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 156/321] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:08 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:09.145568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:09.153124 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-02529b44-069d-4b4f-9e82-717f7d09e152 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1314 microversion: 2.1 time: 0.233574 Jun 24 10:19:09.154024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 166/322] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:08 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:09.220127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:09.221206 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:09.228714 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:09.229296 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:09.230185 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:09.231001 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:09.443316 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:09.451454 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-421e60c1-197b-484f-9363-3799785341c9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.236946 Jun 24 10:19:09.461260 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 157/323] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:09 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:09.682668 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:09.684024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:09.710005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:09.713156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:09.714116 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:09.715814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:09.890285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:09.899233 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:09.900871 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:09.902229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b711127a-5fdc-4b7a-8a48-1165530a8d48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1722 microversion: 2.20 time: 0.225004 Jun 24 10:19:09.903170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 167/324] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:09 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:09.949938 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-1e696bd7-22ae-45f1-a41f-5c7de746e5eb req-0a400931-4b90-4332-975c-fc81862946a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33", "name": "network-vif-plugged", "status": "completed", "tag": "c6a205fe-bd8f-48c8-90b0-9153f04e0de5"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:09.959146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-1e696bd7-22ae-45f1-a41f-5c7de746e5eb req-0a400931-4b90-4332-975c-fc81862946a6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:09.959592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-1e696bd7-22ae-45f1-a41f-5c7de746e5eb req-0a400931-4b90-4332-975c-fc81862946a6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:09.977111 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-1e696bd7-22ae-45f1-a41f-5c7de746e5eb req-0a400931-4b90-4332-975c-fc81862946a6 service nova] Creating event network-vif-plugged:c6a205fe-bd8f-48c8-90b0-9153f04e0de5 for instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 on hv-cinder-84713 Jun 24 10:19:09.982619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-1e696bd7-22ae-45f1-a41f-5c7de746e5eb req-0a400931-4b90-4332-975c-fc81862946a6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036627 Jun 24 10:19:09.983733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 158/325] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:10.103813 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:10.104723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:10.111503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.112489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.113404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.113984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.172006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:10.175491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:10.191831 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.192626 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.193842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.195218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.422523 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:10.452161 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0948f612-aff9-49f0-bf4f-ea55a63da52b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1721 microversion: 2.1 time: 0.348471 Jun 24 10:19:10.452824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 168/326] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:10 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1721 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:10.461861 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:10.467014 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1b32844e-c62b-4130-9e36-8cd911b7c967 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1463 microversion: 2.1 time: 0.299654 Jun 24 10:19:10.467964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 159/327] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:10 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1463 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:10.483069 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:10.484080 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:10.497987 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.499973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.502012 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.503035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.521064 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:10.522429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:10.531633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.532583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.533590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.535270 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.586122 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:19:10.704596 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:10.719563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-94a968f2-943c-4f1f-a2a5-4991d3524452 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.249358 Jun 24 10:19:10.722758 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 169/328] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:10 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:10.770549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-69d3e5cc-8f7e-4ac9-beed-7fec7bf8353a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 204 len: 0 microversion: 2.1 time: 0.256685 Jun 24 10:19:10.771555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 160/329] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:19:10 2022] DELETE /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 0 bytes in 260 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:19:10.785025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:10.786095 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:10.792679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.793699 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.794488 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.795807 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.922107 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:10.922960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:10.942069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.942882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:10.944163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:10.944744 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.046063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.058118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9afbd086-9188-4123-8e29-0763526c58b2 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1469 microversion: 2.1 time: 0.278586 Jun 24 10:19:11.059221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 170/330] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:10 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1469 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:11.141936 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.151990 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.153700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.154953 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1e877c5c-104b-45bd-a3b9-4015c25237f3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1722 microversion: 2.20 time: 0.237354 Jun 24 10:19:11.155998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 161/331] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:10 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:11.470372 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:11.471018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:11.477941 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.478396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.479201 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.479634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.624914 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.633391 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e6812af1-6536-4f60-991d-cfabaea8ad0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1698 microversion: 2.1 time: 0.166982 Jun 24 10:19:11.633991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 171/332] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:11 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1698 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:11.650010 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c9d714f1-f1ad-4de4-8bb0-d4288dab82cf tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:11.656755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c9d714f1-f1ad-4de4-8bb0-d4288dab82cf tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.657207 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c9d714f1-f1ad-4de4-8bb0-d4288dab82cf tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.681670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c9d714f1-f1ad-4de4-8bb0-d4288dab82cf tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Going to try to start instance {{(pid=117855) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 10:19:11.729264 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c9d714f1-f1ad-4de4-8bb0-d4288dab82cf tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.083008 Jun 24 10:19:11.729984 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 162/333] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:19:11 2022] POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:19:11.738436 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:11.739071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:11.739178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:11.739528 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:11.746283 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.746481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.746856 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.747440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.747641 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.748108 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.748248 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:11.748626 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:11.960696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.972885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8bf1daae-c945-4bd2-adc2-03755534e8aa tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.238192 Jun 24 10:19:11.974253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 172/334] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:11 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:11.981105 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:11.989983 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-04820517-04f4-4da2-be0e-ec0f475b41a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1707 microversion: 2.1 time: 0.255136 Jun 24 10:19:11.990525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 163/335] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:11 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1707 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:12.076780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:12.077415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:12.084521 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:12.084967 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:12.085721 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:12.086151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:12.175121 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:12.175630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:12.182580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:12.183414 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:12.184605 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:12.184830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:12.247145 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:12.260118 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-11f0e72a-80ef-4182-af5e-5930f50bff3d tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1469 microversion: 2.1 time: 0.187337 Jun 24 10:19:12.261306 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 173/336] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:12 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1469 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:12.349065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:12.358893 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:12.361271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:12.362692 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d15f4d3c-b29e-4064-89ec-77b3d35d9611 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1722 microversion: 2.20 time: 0.192038 Jun 24 10:19:12.363620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 164/337] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:12 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1722 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:12.445734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "40a1b858-85ea-4441-869b-b0439e139797"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:12.446915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:12.453449 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:12.453887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:12.454639 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:12.455119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:12.879080 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-82ff0d94-fa03-4c4a-934e-f559c6d5772a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.437244 Jun 24 10:19:12.879856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 174/338] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:19:12 2022] POST /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments => generated 194 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:12.991201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:12.992121 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:13.003072 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.003759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.004706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.005880 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.010357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:13.011530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:13.022758 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.024142 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.025163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.025653 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.238389 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:13.249018 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-66c33ea0-c8dc-42b9-be7a-9484fb19825c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1314 microversion: 2.1 time: 0.261634 Jun 24 10:19:13.264671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 165/339] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:12 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:13.264671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-f0df7b04-722b-4d39-b382-de9625a5bb76 req-cce52ecd-2895-487d-821e-067e6123a3ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "name": "network-vif-unplugged", "status": "completed", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:13.267650 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:13.281513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f0df7b04-722b-4d39-b382-de9625a5bb76 req-cce52ecd-2895-487d-821e-067e6123a3ee service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.281993 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f0df7b04-722b-4d39-b382-de9625a5bb76 req-cce52ecd-2895-487d-821e-067e6123a3ee service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.286592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:13.304684 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-da2fae23-a46b-456c-8e41-8401e5c23fd1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1707 microversion: 2.1 time: 0.297894 Jun 24 10:19:13.312574 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 175/340] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:13 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1707 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:13.317667 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:13.324320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:13.332937 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-f0df7b04-722b-4d39-b382-de9625a5bb76 req-cce52ecd-2895-487d-821e-067e6123a3ee service nova] Creating event network-vif-unplugged:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:19:13.338413 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-f0df7b04-722b-4d39-b382-de9625a5bb76 req-cce52ecd-2895-487d-821e-067e6123a3ee service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.082487 Jun 24 10:19:13.340465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.341059 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.342326 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.343033 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.345247 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 166/341] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:13.385776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:13.386742 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:13.413051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.417771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.419362 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.419999 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.490518 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:13.531285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-50c1a5be-94ec-4449-82b3-d4fdb73baf87 tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1427 microversion: 2.1 time: 0.215582 Jun 24 10:19:13.542508 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 176/342] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:13 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1427 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:13.561109 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-73031307-6ab0-41bb-9e43-b423ce198f29 req-5e5323de-caba-4af8-a871-bf3a4dbde05b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a74b8896-2818-4dd1-881b-20ce731e056b", "name": "network-vif-deleted", "tag": "ca85e86d-1048-417d-a0c6-a127ef4567db"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:13.592614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-73031307-6ab0-41bb-9e43-b423ce198f29 req-5e5323de-caba-4af8-a871-bf3a4dbde05b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:13.597481 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-73031307-6ab0-41bb-9e43-b423ce198f29 req-5e5323de-caba-4af8-a871-bf3a4dbde05b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:13.633023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-73031307-6ab0-41bb-9e43-b423ce198f29 req-5e5323de-caba-4af8-a871-bf3a4dbde05b service nova] Creating event network-vif-deleted:ca85e86d-1048-417d-a0c6-a127ef4567db for instance a74b8896-2818-4dd1-881b-20ce731e056b on hv-cinder-84713 Jun 24 10:19:13.639918 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-73031307-6ab0-41bb-9e43-b423ce198f29 req-5e5323de-caba-4af8-a871-bf3a4dbde05b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093632 Jun 24 10:19:13.640648 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 177/343] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:13.767580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:13.776985 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:13.778481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:13.780375 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bbe126c7-9e02-431e-b812-67c6bbb9efb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1722 microversion: 2.20 time: 0.402741 Jun 24 10:19:13.780943 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 167/344] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:13 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1722 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:14.272318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:14.273040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:14.279887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.280338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.281121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.281551 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.322916 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:14.323529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:14.330803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.331313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.332209 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.332664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.470633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:14.478421 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ecc77544-474c-416e-9c47-3869426516c8 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1498 microversion: 2.1 time: 0.210967 Jun 24 10:19:14.478961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 178/345] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:14 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1498 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:14.502351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:14.506254 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.512253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a2aa213b-477b-4ed4-b499-4061c576c27d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1707 microversion: 2.1 time: 0.193274 Jun 24 10:19:14.513233 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 168/346] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:14 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1707 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:14.562491 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:14.563376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:14.566031 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:14.573168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.573758 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.574802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.575357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.613823 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.614282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.614693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lazy-loading 'fault' on Instance uuid a74b8896-2818-4dd1-881b-20ce731e056b {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:19:14.669568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:14.677850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-34068519-9ada-452a-99f5-a12d7292e5ab tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1304 microversion: 2.1 time: 0.121871 Jun 24 10:19:14.678407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 179/347] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:14 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1304 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:14.803062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:14.803638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:14.812475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.812925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.813739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.814172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.927338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:14.927817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:14.934399 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.935334 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.935758 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:14.936193 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:14.963771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:19:14.966635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:14.975014 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:14.976627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:14.977847 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-44f70ba0-ede5-4e04-9bb6-4ffc0d29b70e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1722 microversion: 2.20 time: 0.181368 Jun 24 10:19:14.978759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 169/348] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:14 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:15.000891 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:15.058883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-89334453-2c5a-4738-b496-b70d3dd9b9d0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "DELETE /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 204 len: 0 microversion: 2.1 time: 0.134679 Jun 24 10:19:15.066567 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 180/349] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:19:14 2022] DELETE /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:15.069160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:15.069786 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:15.076374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.076824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.077584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.078017 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.218844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:15.227784 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-51aadc2c-4e0c-4735-8063-5abf8d7cdab0 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1504 microversion: 2.1 time: 0.162714 Jun 24 10:19:15.228352 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 170/350] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:15 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:15.530090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:15.530805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:15.537940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.538392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.539206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.539641 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.676898 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:15.685507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-753fe7c8-3dd7-4a5a-b5e2-55618e71e30d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1707 microversion: 2.1 time: 0.159948 Jun 24 10:19:15.686081 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 181/351] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:15 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:15.695281 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:15.695840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:15.703497 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.703952 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.704715 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.705145 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.739599 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:15.740043 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:15.740484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lazy-loading 'fault' on Instance uuid a74b8896-2818-4dd1-881b-20ce731e056b {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:19:15.784638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:15.792531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-111d185d-617e-4a10-ade3-9e84e4d2045a tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1304 microversion: 2.1 time: 0.101096 Jun 24 10:19:15.793096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 171/352] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:15 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:15.999149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:16.001089 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:16.012149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.012596 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.013513 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.014645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.163670 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:16.171896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:16.173404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:16.174548 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-26002517-ce05-4bc8-a1ed-13ac711e21a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1722 microversion: 2.20 time: 0.181461 Jun 24 10:19:16.175163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 182/353] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:15 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:16.247134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:16.247700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:16.255116 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.255563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.256334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.256770 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.398323 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:16.409041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-32563e32-0ecf-41bc-beea-41c71dc45633 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1504 microversion: 2.1 time: 0.166588 Jun 24 10:19:16.409980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 172/354] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:16 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:16.705733 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:16.706331 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:16.714025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.714858 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.715669 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.716100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.810039 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:16.810923 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:16.817977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.818477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.819257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.819677 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.852313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:16.852755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:16.853208 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lazy-loading 'fault' on Instance uuid a74b8896-2818-4dd1-881b-20ce731e056b {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:19:16.866278 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:16.875165 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-cc5cd65c-a235-4890-8a68-a80ef10a827e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1707 microversion: 2.1 time: 0.174498 Jun 24 10:19:16.875913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 183/355] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:16 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1707 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:16.898574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd25025d4a28e451fb4e60b5a1e97ce4c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f68ef0ce863f43cdab4afcba5329f925', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:16.907053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e2c6c779-4fde-4e30-808c-33ddf2b247de tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 200 len: 1304 microversion: 2.1 time: 0.100434 Jun 24 10:19:16.907694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 173/356] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:16 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 1304 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:17.193149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:17.193761 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:17.200270 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.200745 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.201518 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.201930 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.386625 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:17.394846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:17.400120 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:17.402017 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-03e159d7-6952-469c-87bd-adcd1102b1ec tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1665 microversion: 2.20 time: 0.212650 Jun 24 10:19:17.402679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 184/357] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:17 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1665 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:17.420410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd3faf5d-5acf-4769-862a-443e3bca75a4"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:17.422115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:17.433538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.434492 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.435419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:17.436007 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.436121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:17.437094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.443092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.443543 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.444547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.445013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.613168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:17.626565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-00f9681d-94ea-40c1-b2cb-48ca0845667a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1504 microversion: 2.1 time: 0.200602 Jun 24 10:19:17.636092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 185/358] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:17 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1504 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:17.783969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a28aa702-a308-4d28-9b38-076c64b30056 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.367461 Jun 24 10:19:17.785210 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 174/359] 10.222.0.64 () {62 vars in 1363 bytes} [Fri Jun 24 10:19:17 2022] POST /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:19:17.901149 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:17.901759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:17.907442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:17.908014 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:17.909536 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.910185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.910994 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.911425 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.915410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.916044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:17.917058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:17.919692 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.045767 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1c410ed1-e2be-4723-945b-be925a892ee2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/action" status: 202 len: 0 microversion: 2.20 time: 0.142264 Jun 24 10:19:18.050630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 175/360] 10.222.0.64 () {62 vars in 1318 bytes} [Fri Jun 24 10:19:17 2022] POST /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:18.052298 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:18.052976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] [instance: a74b8896-2818-4dd1-881b-20ce731e056b] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:18.060547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.060673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.061595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.062098 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.087108 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] HTTP exception thrown: Instance a74b8896-2818-4dd1-881b-20ce731e056b could not be found. Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Request method failure captured: Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b HTTP/1.1 Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY-ISZbjzFj0Ln57DkHytZSGTACFgZXoK28ofWer9C_Ua_jYiQDOdi4V7sed1GwYw5W1IJFZZDMSGzym4X9R_1VVu_wmwEJHvepITHanirI_lO7bqDfNWMIJWrgvKo133E1i1ifQivqNtThLZS0aVlEKnhyAdKMUapCrkqtBA8GO2iA Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: f68ef0ce863f43cdab4afcba5329f925 Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-VolumesNegativeTest-429150236 Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:19:18.088823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f68ef0ce863f43cdab4afcba5329f925"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f68ef0ce863f43cdab4afcba5329f925", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f68ef0ce863f43cdab4afcba5329f925"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f68ef0ce863f43cdab4afcba5329f925"}]}] Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-VolumesNegativeTest-429150236 Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: f68ef0ce863f43cdab4afcba5329f925 Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-VolumesNegativeTest-429150236 Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-VolumesNegativeTest-429150236-project Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: d25025d4a28e451fb4e60b5a1e97ce4c Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-VolumesNegativeTest-429150236-project Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance a74b8896-2818-4dd1-881b-20ce731e056b could not be found. Jun 24 10:19:18.090500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'a74b8896-2818-4dd1-881b-20ce731e056b'} Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a74b8896-2818-4dd1-881b-20ce731e056b could not be found. Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:19:18.091321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a74b8896-2818-4dd1-881b-20ce731e056b could not be found. Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a74b8896-2818-4dd1-881b-20ce731e056b could not be found. Jun 24 10:19:18.092513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:19:18.093684 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] Returning 404 to user: Instance a74b8896-2818-4dd1-881b-20ce731e056b could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:19:18.093684 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6ebd5f5b-328f-46da-a903-61ee5527e6bc tempest-VolumesNegativeTest-429150236 tempest-VolumesNegativeTest-429150236-project] 10.222.0.64 "GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b" status: 404 len: 111 microversion: 2.1 time: 0.042249 Jun 24 10:19:18.093684 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 176/361] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:18 2022] GET /compute/v2.1/servers/a74b8896-2818-4dd1-881b-20ce731e056b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:19:18.096850 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-97592807-5112-49d2-b675-9092beb83a38 req-4eb973fa-c5ae-493d-9afd-5ddbfaf0caea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33", "name": "network-vif-deleted", "tag": "c6a205fe-bd8f-48c8-90b0-9153f04e0de5"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:18.101255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:18.119188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-97592807-5112-49d2-b675-9092beb83a38 req-4eb973fa-c5ae-493d-9afd-5ddbfaf0caea service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.119629 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-97592807-5112-49d2-b675-9092beb83a38 req-4eb973fa-c5ae-493d-9afd-5ddbfaf0caea service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.128406 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-cb1ca17e-bf81-4d95-8029-9aad132df6ac tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1707 microversion: 2.1 time: 0.231885 Jun 24 10:19:18.129349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 186/362] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:17 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1707 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:18.133214 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-97592807-5112-49d2-b675-9092beb83a38 req-4eb973fa-c5ae-493d-9afd-5ddbfaf0caea service nova] Creating event network-vif-deleted:c6a205fe-bd8f-48c8-90b0-9153f04e0de5 for instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 on hv-cinder-84713 Jun 24 10:19:18.138101 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:18.139593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:18.140596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-97592807-5112-49d2-b675-9092beb83a38 req-4eb973fa-c5ae-493d-9afd-5ddbfaf0caea service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047634 Jun 24 10:19:18.141426 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 177/363] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:18.152735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.153282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.154088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.154525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.321655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:18.330457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:18.332348 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:18.333515 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4a458e5f-b86b-40d1-bc18-7b8890d8adea tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1751 microversion: 2.20 time: 0.203020 Jun 24 10:19:18.334663 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 187/364] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:18 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1751 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:18.644989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:18.645710 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:18.653197 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=4 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:18.663674 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.664443 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.665240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.665974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.731883 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:18.732675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:18.733402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lazy-loading 'fault' on Instance uuid dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:19:18.776125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:18.784060 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b5920471-c608-439b-833a-984b9d7513b7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 200 len: 1304 microversion: 2.1 time: 0.143725 Jun 24 10:19:18.784868 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 178/365] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:18 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 1304 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:19.145910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:19.147266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:19.160074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:19.160531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:19.161299 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:19.161735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:19.353152 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:19.354588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:19.363099 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:19.364053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:19.365787 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:19.366750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:19.367037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:19.379358 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b2ea6e02-5cbd-4b81-aa11-c8f3cd17f383 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1711 microversion: 2.1 time: 0.237687 Jun 24 10:19:19.383217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 188/366] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:19 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1711 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:19.533019 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:19.542791 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:19.544337 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:19.545697 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2b178978-1319-44cf-a3d8-ac75989508a6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1751 microversion: 2.20 time: 0.196657 Jun 24 10:19:19.546720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 179/367] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:19 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1751 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:19.803417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:19.804286 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:19.813530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:19.814211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:19.815276 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:19.815866 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:19.832662 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] HTTP exception thrown: Instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 could not be found. Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Request method failure captured: Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 HTTP/1.1 Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY-NB01ZYAGdEnHoWZ45vvP-q8rP0-SlbpjzADMbA8QotzU6-JXgtol4-agmt_-YmKSVN7TjONGrj5dO-YAxfo4GAJ5eXLCCgNHY8CMgqYlMiIpUWQhj76PNY7sSdfKY0KwjlMb_PgUSCjvQuffPobFyS4DpisQGPdhcMlgRs2xg-9s Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 4a8a290c7de54fb892f408f3d4f1e657 Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesActionsTest-1713171782 Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:19:19.834636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4a8a290c7de54fb892f408f3d4f1e657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4a8a290c7de54fb892f408f3d4f1e657", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4a8a290c7de54fb892f408f3d4f1e657"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4a8a290c7de54fb892f408f3d4f1e657"}]}] Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesActionsTest-1713171782 Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 4a8a290c7de54fb892f408f3d4f1e657 Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesActionsTest-1713171782 Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesActionsTest-1713171782-project Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 516e13cf120a461d8632844453635fa9 Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesActionsTest-1713171782-project Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 could not be found. Jun 24 10:19:19.835965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33'} Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 could not be found. Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:19:19.836793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 could not be found. Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 could not be found. Jun 24 10:19:19.837970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:19.845919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Returning 404 to user: Instance dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:19:19.845919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4faf62fb-8880-4f10-8f8a-38cd6af26efe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33" status: 404 len: 111 microversion: 2.1 time: 0.037719 Jun 24 10:19:19.845919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 189/368] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:19 2022] GET /compute/v2.1/servers/dcf0e71f-7054-4aaa-b7f4-637dc8e7fd33 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:19:19.953428 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1194434200", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "networks": [{"uuid": "68ae0d24-43c3-4ab7-b393-8a1204423670"}]}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:20.016827 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] validate_networks() for [('68ae0d24-43c3-4ab7-b393-8a1204423670', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:19:20.392093 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:19:20.392628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:19:20.393667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:19:20.394080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:19:20.394484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:19:20.407570 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:20.408304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:20.409317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:20.409841 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:20.435057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Getting quotas for project 4a8a290c7de54fb892f408f3d4f1e657. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:19:20.439993 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Getting quotas for user 516e13cf120a461d8632844453635fa9 and project 4a8a290c7de54fb892f408f3d4f1e657. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:19:20.450974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:19:20.453902 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:19:20.507279 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-dbca671e-407e-4373-9c5f-841c4f2422ea tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557678 Jun 24 10:19:20.508222 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 180/369] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:19:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:19:20.519640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d55da99d-4f49-4922-b9b3-0579b6f149f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:20.520261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d55da99d-4f49-4922-b9b3-0579b6f149f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:20.569676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:20.570284 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:20.579127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:20.579838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:20.581491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:20.581936 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:20.602937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d55da99d-4f49-4922-b9b3-0579b6f149f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:20.611097 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d55da99d-4f49-4922-b9b3-0579b6f149f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1214 microversion: 2.1 time: 0.096835 Jun 24 10:19:20.611978 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 190/370] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:20 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1214 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:20.984386 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:20.995239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:20.996738 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:20.997977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9778a3ab-dbd5-4179-ab55-9b2773ceb5a4 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1753 microversion: 2.20 time: 0.433055 Jun 24 10:19:20.998527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 181/371] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:20 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1753 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:21.534966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:21.536042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:21.543765 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:21.544210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:21.544974 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:21.545440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:21.568581 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lazy-loading 'flavor' on Instance uuid 89570c7f-aa48-4b00-8f01-4db37fae4d62 {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:19:21.633632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:21.635011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:21.644969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:21.645587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:21.646223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:21.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:21.737946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:21.742790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:21.746977 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-07784712-b488-4458-91aa-50b23d95aa71 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/action" status: 200 len: 32 microversion: 2.1 time: 0.216305 Jun 24 10:19:21.747657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 191/372] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:19:21 2022] POST /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/action => generated 32 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:19:21.748553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-449f76c2-a5a2-4e8c-9568-202bbe776aba tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1266 microversion: 2.1 time: 0.121020 Jun 24 10:19:21.749359 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 182/373] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:21 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1266 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:21.757667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:21.758300 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:21.766640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:21.767114 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:21.768297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:21.769473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:21.934196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:21.943748 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ff3e813a-1516-4205-970c-fe872cfb370e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.190414 Jun 24 10:19:21.944361 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 183/374] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:21 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:22.018526 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:22.019553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:22.026422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:22.026904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:22.027910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:22.028400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:22.178769 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:22.187875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:22.189418 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:22.190604 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d59f8dfb-c005-42c5-882d-f6dfc12da7a5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1753 microversion: 2.20 time: 0.177670 Jun 24 10:19:22.191368 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 192/375] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:22 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1753 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:22.767544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:22.769644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:22.777536 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:22.777980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:22.778821 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:22.779249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:22.929906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:22.938179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6dc9bb1c-2e42-4968-a5ba-8861d6a3dee1 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.176419 Jun 24 10:19:22.949074 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 184/376] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:22 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:22.961571 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:22.962279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:22.970392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:22.970917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:22.971771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:22.972213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:23.143969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:23.153051 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0d8a7f33-6d02-4bff-83e5-d1c6ffedb50c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.195554 Jun 24 10:19:23.154172 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 193/377] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:22 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:23.209785 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:23.212509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:23.222140 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:23.222595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:23.223425 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:23.224022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:23.385892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:23.405087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:23.406644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:23.414949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2002af2f-8ef8-4a8a-999d-615327a1bf0e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.209025 Jun 24 10:19:23.415522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 185/378] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:23 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:23.957066 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:23.957706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:23.964853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:23.965495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:23.966162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:23.966598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:24.120572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:24.128440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2210c89f-99f2-46a6-bb58-55e475a2b180 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.176436 Jun 24 10:19:24.137965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 194/379] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:23 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:24.171549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:24.172257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:24.183326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:24.186576 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:24.188935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:24.189396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:24.347169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:24.357412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-6e111b02-55b1-4a72-825d-1d39beead6df req-7a3603d8-eaf7-4c5b-88ea-e2fde598a121 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf", "tag": "8d7ed742-d658-41ac-bf26-1bddaf55fa57"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:24.360955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d3edcd7d-4da7-4b02-8700-99dd2b80ed82 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.193252 Jun 24 10:19:24.361546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 186/380] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:24 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:24.388782 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-6e111b02-55b1-4a72-825d-1d39beead6df req-7a3603d8-eaf7-4c5b-88ea-e2fde598a121 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:24.390726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-6e111b02-55b1-4a72-825d-1d39beead6df req-7a3603d8-eaf7-4c5b-88ea-e2fde598a121 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:24.407428 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-6e111b02-55b1-4a72-825d-1d39beead6df req-7a3603d8-eaf7-4c5b-88ea-e2fde598a121 service nova] Creating event network-changed:8d7ed742-d658-41ac-bf26-1bddaf55fa57 for instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf on hv-cinder-84713 Jun 24 10:19:24.413390 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-6e111b02-55b1-4a72-825d-1d39beead6df req-7a3603d8-eaf7-4c5b-88ea-e2fde598a121 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067277 Jun 24 10:19:24.414063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 195/381] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:24.434211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:24.435057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:24.447852 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:24.448646 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:24.449620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:24.450225 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:24.665773 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:24.676617 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:24.678282 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:24.679507 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b1a2b3fd-c89e-4d02-a1f5-b9fc0fadb962 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.249963 Jun 24 10:19:24.680065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 187/382] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:24 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:25.149314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:25.151117 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:25.161817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:25.163051 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:25.164181 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:25.164831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:25.343432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:25.352269 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-247dac66-d7c4-4906-b512-abb3dbb30868 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.208166 Jun 24 10:19:25.352846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 196/383] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:25 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:25.378349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:25.379687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:25.392908 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:25.393665 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:25.394648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:25.403778 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:25.549395 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:25.558056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bb210f44-26ee-4c64-a147-0ca3910ae9e3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.184454 Jun 24 10:19:25.558632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 188/384] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:25 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:25.651146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1446913342", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2005574597", "security_groups": [{"name": "tempest-secgroup-smoke-1126505114"}], "networks": [{"uuid": "fcb34be5-02e9-434d-ab19-3848e7eb46d8"}], "block_device_mapping_v2": [{"uuid": "f721fd8b-1989-474f-97bc-8cf568601c6d", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:25.701194 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:25.702315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:25.709975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:25.711588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:25.712539 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:25.713125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:25.858385 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] validate_networks() for [('fcb34be5-02e9-434d-ab19-3848e7eb46d8', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:19:26.000663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:26.016813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:26.018318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:26.019769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1c8e05ad-6dbf-4aff-a542-8bf884a17fbb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.322737 Jun 24 10:19:26.020326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 189/385] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:25 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:26.349349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:19:26.349892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:19:26.350223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:19:26.350628 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:19:26.351185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:19:26.360937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:26.361381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:26.362174 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:26.362602 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:26.369761 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:26.370609 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:26.372196 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:26.378134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:26.378855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:26.380309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:26.380899 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:26.397861 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Getting quotas for project 90f6878fdaaf43b58b92bea357331d2e. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:19:26.402103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Getting quotas for user 23c7ecdb284d4ad0bda072a87ad8984c and project 90f6878fdaaf43b58b92bea357331d2e. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:19:26.496466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:19:26.498741 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f721fd8b-1989-474f-97bc-8cf568601c6d',volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:19:26.558040 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:26.567127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-01b6aa54-0898-4d0d-bc57-6e2a3d023021 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.201396 Jun 24 10:19:26.569193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 190/386] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:26 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:26.575839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:26.577355 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:26.583830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:26.584591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:26.585406 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:26.585994 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:26.691209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fe9f81f4-846c-40fd-9bfe-17e528e9d8be tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.043848 Jun 24 10:19:26.691859 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 197/387] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:19:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1045 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:19:26.729073 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a404f9f7-988a-4a71-a2c0-7e2291cead2e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:26.729943 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a404f9f7-988a-4a71-a2c0-7e2291cead2e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:26.797831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a404f9f7-988a-4a71-a2c0-7e2291cead2e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:26.805240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:26.809914 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a404f9f7-988a-4a71-a2c0-7e2291cead2e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1089 microversion: 2.1 time: 0.110770 Jun 24 10:19:26.815200 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 198/388] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:26 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1089 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:26.815457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-67bb93b8-5b36-480b-a854-18f2e53cb17e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.243122 Jun 24 10:19:26.816020 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 191/389] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:26 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:27.038697 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:27.039338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:27.058957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.063477 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.064282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.064727 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.252986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:27.270590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:27.272378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:27.274038 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e684c37a-7c38-4993-a01a-2f4bcd61ee6d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.240055 Jun 24 10:19:27.275256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 199/390] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:27 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:27.584873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:27.585497 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:27.592843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.594175 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.595181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.595822 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.753408 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:27.762169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0950f2e9-2752-4cef-b2a8-92aeca0724d6 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.181209 Jun 24 10:19:27.763055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 192/391] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:27 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:27.828256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:27.829136 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:27.835499 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.836266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.836675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:27.837369 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.837670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:27.838008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.845845 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.846595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.847702 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:27.848301 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:27.944951 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:27.952863 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-bf884f56-0a67-4931-95f8-de34e1d38b79 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.129131 Jun 24 10:19:27.953431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 200/392] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:27 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:28.013132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:28.037786 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-862f8f91-6601-48b7-a63b-fdd94264173e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.204834 Jun 24 10:19:28.038543 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 193/393] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:27 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:28.296296 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:28.297245 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:28.305843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:28.306659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:28.307921 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:28.308572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:28.466690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:28.476342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:28.478025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:28.481846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d70b047c-3beb-41a2-ba64-e11213366c58 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.191892 Jun 24 10:19:28.483157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 201/394] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:28 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:28.779218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:28.780826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:28.788220 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:28.788955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:28.789895 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:28.790767 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:28.932600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:28.940742 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f179edbe-6016-4d21-8181-f3e451a704ee tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.165404 Jun 24 10:19:28.942555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 194/395] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:28 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:28.972122 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:28.972725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:28.981371 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:28.981827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:28.982608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:28.983067 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:29.050075 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:29.055463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:29.056087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:29.058315 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7b303972-ebe5-4cf2-8526-137a5a23132f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.091273 Jun 24 10:19:29.059254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 202/396] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:28 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:29.062199 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:29.062649 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:29.063451 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:29.063889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:29.200216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:29.209769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b71cab83-8e35-4dc5-a403-f2204d2a6fe5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.158203 Jun 24 10:19:29.210348 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 195/397] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:29 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:29.501603 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:29.502210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:29.509249 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:29.509709 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:29.510465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:29.510925 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:29.649562 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:29.658581 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:29.660097 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:29.661247 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ff5c8663-bee7-4158-b983-0775585f44db tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.163983 Jun 24 10:19:29.661798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 203/398] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:29 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:29.957869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:29.958483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:29.966531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:29.967026 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:29.968224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:29.968760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.076991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:30.079932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:30.087732 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:30.088178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.089892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:30.090286 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.128162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:30.136231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bbe3a651-2068-4fbd-a086-a9924699016b tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.182277 Jun 24 10:19:30.137027 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 196/399] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:29 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:30.159144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:30.168376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-985007b3-bb87-41bc-b897-9167e7ae2ca4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.096595 Jun 24 10:19:30.179044 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 204/400] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:30 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:30.228621 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:30.229140 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:30.236413 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:30.237178 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.238223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:30.238840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.421479 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:30.429451 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:30.437088 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d5fde544-5046-4550-92b3-5ff36c3d50be tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.212816 Jun 24 10:19:30.437801 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 197/401] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:30 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:30.682303 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:30.682942 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:30.697130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:30.698067 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.699039 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:30.699480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:30.841877 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:30.853828 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:30.855910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:30.857618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6f2d33e4-09fc-4a07-ae0b-edfe4f07f955 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.179302 Jun 24 10:19:30.869973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 205/402] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:30 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:31.154606 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:31.155278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:31.157283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:31.163691 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.164144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.164981 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.165415 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.187064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:31.187987 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:31.194969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.195378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.196320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.196938 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.288122 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:31.295880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e21a65c2-55dd-441c-ad83-a3eed2a2c764 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.112761 Jun 24 10:19:31.299422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 206/403] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:31 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:31.366393 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:31.373835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ec77d9dc-c879-4633-b7d8-2e72a4f44bdf tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.223198 Jun 24 10:19:31.374564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 198/404] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:31 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:31.456245 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:31.456864 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:31.463931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.464913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.465693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.466130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.604246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:31.614487 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-71673a40-194c-4f89-88de-6f87b16de33c tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.163396 Jun 24 10:19:31.615399 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 207/405] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:31 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:31.881659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:31.882734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:31.893918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.894825 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.896121 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:31.896844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:31.921041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:32.041853 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:32.050817 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:32.052321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:32.053537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8d3c94d2-1b58-48a5-a5d3-c1138d43ca99 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.179519 Jun 24 10:19:32.054075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 199/406] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:31 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:32.315776 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:32.316605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:32.324568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:32.325561 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:32.326795 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:32.327609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:32.391589 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:32.392239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:32.396221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:32.399568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:32.399994 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:32.400894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:32.401541 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:32.404117 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-41768acb-b684-4dc1-bc0c-ead032c60761 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.092426 Jun 24 10:19:32.416725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 208/407] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:32 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:32.563525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:32.573039 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5cf119e2-5a4b-4fcf-b9cd-8e9f8b11cfff tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.186079 Jun 24 10:19:32.574013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 200/408] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:32 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:32.633375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:32.634601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:32.655939 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:32.656547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:32.657483 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:32.657919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:32.793634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:32.803738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2ae8acaa-fa18-45fb-8706-bc562888cbf3 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.175368 Jun 24 10:19:32.805543 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 209/409] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:32 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:33.076887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:33.077941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:33.084659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.085404 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.086188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.086597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.226053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:33.239018 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:33.240493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:33.241648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5054f0c8-1c55-4281-9f92-8f8203819e92 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.171499 Jun 24 10:19:33.242198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 201/410] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:33 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:33.430490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:33.431476 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:33.440496 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.440945 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.441705 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.442143 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.505510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:33.517151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-78dee536-e241-4570-9537-17f418162744 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.092818 Jun 24 10:19:33.517874 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 210/411] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:33 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:33.592112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:33.592960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:33.599900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.600359 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.601125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.601564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.744112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:33.752820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bf9f5d0a-ae4f-4a37-8878-921399e470f3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.165724 Jun 24 10:19:33.753597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 202/412] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:33 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:33.825850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:33.826774 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:33.834223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.834675 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.835475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:33.835885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:33.984052 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:33.992750 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-da655e38-6550-4b95-915e-942dfba6bf73 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.173107 Jun 24 10:19:33.993252 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 211/413] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:33 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:34.262537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:34.263144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:34.270758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:34.271308 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:34.272198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:34.272718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:34.415035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:34.423979 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:34.425483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:34.426657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a34c8b28-06a6-48d0-9533-6ee0c62d1742 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.168979 Jun 24 10:19:34.427265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 203/414] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:34 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:34.539204 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:34.539883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:34.546762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:34.547237 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:34.547991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:34.548439 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:34.617899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:34.625419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d007346b-f6cf-4b78-a805-2f3b7bfb4800 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1139 microversion: 2.1 time: 0.090053 Jun 24 10:19:34.625982 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 212/415] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:34 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1139 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:34.772288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:34.772869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:34.779184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:34.779784 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:34.780560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:34.780995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:34.921186 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:34.929636 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a5c612e4-d514-4e6f-9e4d-26b033f42994 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.163702 Jun 24 10:19:34.930209 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 204/416] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:34 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:35.012400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:35.013206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:35.021466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.022138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.023417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.023950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.166146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:35.178426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5a9301c7-6cce-4516-a623-3a94d2e1ccc0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.171261 Jun 24 10:19:35.179088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 213/417] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:35 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:35.447796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:35.448763 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:35.451727 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:35.459032 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.459484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.460240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.460672 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.601060 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:35.609725 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:35.611217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:35.612866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-12c209cb-83b7-4a91-a302-9c957b8c1e72 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.170683 Jun 24 10:19:35.613398 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 205/418] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:35 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:35.642153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:35.642768 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:35.649841 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.650289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.651090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.651522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.716426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:35.724759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c2eedfc2-1383-4cf0-a057-3390cd2f5aab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1131 microversion: 2.1 time: 0.086491 Jun 24 10:19:35.725291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 214/419] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:35 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1131 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:35.951444 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:35.952126 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:35.959790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.960169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:35.960968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:35.961392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.095072 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:36.103170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6d59d5de-4886-444e-9699-12faa5296bb2 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.155917 Jun 24 10:19:36.103737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 206/420] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:35 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:36.198336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:36.199252 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:36.202008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.209468 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:36.209970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.210681 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:36.211152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.230559 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.366985 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:36.374508 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.382631 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-25143f8c-54f2-4ca1-b029-e0883a0de87e tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.190061 Jun 24 10:19:36.383407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 215/421] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:36 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:36.637170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:36.637787 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:36.644597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:36.645117 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.652184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:36.652184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.742464 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:36.743096 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:36.752945 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:36.755088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.755906 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:36.756341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:36.789150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:36.797701 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:36.799226 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:36.800598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0afd5614-69f9-4c23-a413-de0c51af2aae tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.167414 Jun 24 10:19:36.802359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=10 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:36.811335 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 207/422] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:36 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:36.832495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:36.840568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-51c18807-8218-4aa8-92ef-33b53a50aef3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1131 microversion: 2.1 time: 0.102811 Jun 24 10:19:36.841134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 216/423] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:36 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1131 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:37.126103 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:37.127169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:37.134962 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.135406 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.136163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.136596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.225371 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:19:37.225533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:19:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:19:37.277004 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:37.284455 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-58606323-0e99-42a7-98b1-8c89bd11d8e3 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.165373 Jun 24 10:19:37.285010 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 208/424] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:37 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:37.400499 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:37.401122 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:37.407701 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.408144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.408904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.409341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.547074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:37.555780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c29a553f-99da-40b5-81e3-ec7ff774b805 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.159204 Jun 24 10:19:37.556337 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 217/425] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:37 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:37.819395 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:37.820007 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:37.826694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.827174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.827944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.828390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.857827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:37.858663 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:37.865372 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.865866 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.866812 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:37.867255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:37.933740 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:37.941578 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b7f54a9c-a391-4156-8aaa-e720cd304275 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1131 microversion: 2.1 time: 0.088387 Jun 24 10:19:37.942205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 218/426] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:37 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1131 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:37.993735 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:38.002365 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:38.003887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:38.005050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-93aa5969-98e5-4463-99be-2999a5f67859 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.189984 Jun 24 10:19:38.005803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 209/427] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:37 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:38.311770 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:38.312315 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:38.318732 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:38.319184 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:38.320001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:38.320395 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:38.459430 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:38.468429 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a3efee5b-1fe5-49c7-b9f6-6132232e13fe tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.160791 Jun 24 10:19:38.469226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 219/428] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:38 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:38.573203 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:38.573955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:38.581760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:38.582483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:38.583604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:38.584644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:38.737519 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:38.745935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5793fcc9-c453-4fd2-9b0f-b204bb0b5a49 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.176731 Jun 24 10:19:38.746767 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 210/429] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:38 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:38.961046 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:38.961663 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:38.969085 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:38.969862 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:38.970822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:38.971330 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.024020 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:39.025105 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:39.032704 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:39.033448 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.034455 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:39.035203 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.048135 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:39.059950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4a22e92e-72ac-4caa-8585-9c9cb69f8b48 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1205 microversion: 2.1 time: 0.102628 Jun 24 10:19:39.060854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 220/430] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:38 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1205 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:39.229410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:39.241365 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:39.243924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:39.244559 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-25939df2-c5e4-4707-be10-c46b33fe2268 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.225609 Jun 24 10:19:39.245272 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 211/431] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:39 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:39.486502 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:39.487301 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:39.499860 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:39.501001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.502455 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:39.503370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.706506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:39.721624 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-053456ad-def7-4c71-8194-2306fe74f6d7 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.239669 Jun 24 10:19:39.723119 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 221/432] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:39 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:39.763396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:39.764016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:39.772942 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:39.773739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.774527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:39.774993 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:39.942267 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:39.969776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1d2256fd-f14f-493b-b7cd-7f708baa81ce tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.210703 Jun 24 10:19:39.970342 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 212/433] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:39 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:40.081958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:40.082613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:40.104574 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.105695 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.106830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.107444 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.142359 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-a621d3a8-7ac6-448a-b249-e13f18571cb8 req-b4e1679d-fbf6-4317-84ad-cfa60e959f2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf", "name": "network-vif-plugged", "status": "completed", "tag": "8d7ed742-d658-41ac-bf26-1bddaf55fa57"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:40.154081 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-a621d3a8-7ac6-448a-b249-e13f18571cb8 req-b4e1679d-fbf6-4317-84ad-cfa60e959f2c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.158463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-a621d3a8-7ac6-448a-b249-e13f18571cb8 req-b4e1679d-fbf6-4317-84ad-cfa60e959f2c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.182821 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-a621d3a8-7ac6-448a-b249-e13f18571cb8 req-b4e1679d-fbf6-4317-84ad-cfa60e959f2c service nova] Creating event network-vif-plugged:8d7ed742-d658-41ac-bf26-1bddaf55fa57 for instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf on hv-cinder-84713 Jun 24 10:19:40.192789 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-a621d3a8-7ac6-448a-b249-e13f18571cb8 req-b4e1679d-fbf6-4317-84ad-cfa60e959f2c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053294 Jun 24 10:19:40.195760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 213/434] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:19:40.266309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:40.267427 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:40.281449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.282022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.282935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.283659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.303350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:40.313875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6ffb7a98-eedd-4906-abc5-77af0f81cdbb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.237595 Jun 24 10:19:40.314951 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 222/435] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:40 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:40.321774 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-e0386adc-7687-42e3-b0a9-08af644abbbc req-24ed4f61-ad85-45bb-8454-c381dd86be7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:40.340254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e0386adc-7687-42e3-b0a9-08af644abbbc req-24ed4f61-ad85-45bb-8454-c381dd86be7b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.340799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e0386adc-7687-42e3-b0a9-08af644abbbc req-24ed4f61-ad85-45bb-8454-c381dd86be7b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.361991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-e0386adc-7687-42e3-b0a9-08af644abbbc req-24ed4f61-ad85-45bb-8454-c381dd86be7b service nova] Creating event network-changed:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:19:40.368849 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-e0386adc-7687-42e3-b0a9-08af644abbbc req-24ed4f61-ad85-45bb-8454-c381dd86be7b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051878 Jun 24 10:19:40.370005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 223/436] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:40.475423 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:40.484883 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:40.486373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:40.488063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bffd6fde-84a4-4709-9bd8-6fc178931a57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.226728 Jun 24 10:19:40.495659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 214/437] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:40 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:40.739456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:40.740222 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:40.749176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.749840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.751461 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.752104 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.893111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:40.901274 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ec65ea75-b9a1-41d0-9d75-90f66578c1d9 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1314 microversion: 2.1 time: 0.166061 Jun 24 10:19:40.901899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 224/438] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:40 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:40.988762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:40.989627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:40.996453 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.997037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:40.997890 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:40.998398 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:41.140017 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:41.148169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3e43b601-f31c-4533-be04-a8b4a9f4e148 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.164025 Jun 24 10:19:41.148946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 215/439] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:40 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:41.331507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:41.332285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:41.340236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:41.340678 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:41.341428 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:41.341852 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:41.477952 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:41.485652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8e823719-ef6f-4475-8e0f-3ed8102662bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.158013 Jun 24 10:19:41.486180 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 225/440] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:41 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:41.511684 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:41.512457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:41.518859 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:41.519309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:41.520170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:41.520610 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:41.664670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:41.668293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:41.674389 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:41.675916 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:41.677083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3b0d0f6c-7d52-44a2-a548-295aea9e7f95 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.171288 Jun 24 10:19:41.677638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 216/441] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:41 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:41.919744 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:41.920504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:41.928412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:41.928860 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:41.929608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:41.930058 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.079833 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.089030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e5e999ab-fb19-4aa7-b1a8-5e5db4953784 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1498 microversion: 2.1 time: 0.174281 Jun 24 10:19:42.090235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 226/442] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:41 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1498 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:42.168281 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:42.168281 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:42.174353 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.174836 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.175595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.176033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.333387 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.343340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3f70b54d-9513-467b-8ee3-02963f0dd988 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.181424 Jun 24 10:19:42.352758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 217/443] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:42 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:42.502015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:42.502618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:42.509928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.510412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.511255 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.511722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.613347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:42.613924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:42.620306 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.620870 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.621682 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.622176 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.646658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.650044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:19:42.654663 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b3854d1c-8f79-4712-9eab-adb232c67dbf tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.156808 Jun 24 10:19:42.655263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 227/444] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:42 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:42.700517 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:42.701117 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:42.707314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.707762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.708530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.709103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.737153 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-753302ca-58a3-4b19-b3d0-9e495377246a tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "DELETE /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 204 len: 0 microversion: 2.1 time: 0.127374 Jun 24 10:19:42.738187 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 218/445] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:19:42 2022] DELETE /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:19:42.747349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:42.748064 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:42.754487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.754992 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.755813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:42.756244 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:42.894560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.903869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.905475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.906792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-31c81b3a-d616-4774-ae15-40534734ddfe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.210439 Jun 24 10:19:42.907445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 228/446] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:42 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:42.921658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:42.929773 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ee02efe7-f130-4111-86c6-6c4ccc6f9091 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1504 microversion: 2.1 time: 0.187044 Jun 24 10:19:42.930332 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 219/447] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:42 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:43.360923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:43.361523 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:43.368504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.368994 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.369761 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.370270 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.514644 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:43.523402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-65562314-e216-433e-8d6e-ef8738a07968 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.166541 Jun 24 10:19:43.523982 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 229/448] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:43 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:43.672242 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:43.672859 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:43.680516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.681200 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.682159 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.682603 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.820568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:43.828388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9bdf5580-2eb0-4e9f-ae21-b0fb32aac5ac tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.160174 Jun 24 10:19:43.828957 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 220/449] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:43 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:43.925501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:43.925991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:43.933308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.933752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.934552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.935110 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.947462 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:43.948093 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:43.954771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.955225 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:43.955993 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:43.956433 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:44.141140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:44.148200 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:44.150660 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:44.152290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:44.153490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8ce1667b-3efa-428c-885d-e091d800b023 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.232031 Jun 24 10:19:44.154247 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 230/450] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:43 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:44.156106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e6efe3f5-5a41-4f9d-b3a1-d2ab1c17734d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1504 microversion: 2.1 time: 0.213380 Jun 24 10:19:44.156662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 221/451] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:43 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1504 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:44.540945 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:44.541493 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:44.548181 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:44.548623 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:44.549374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:44.549801 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:44.712749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:44.721529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e6e2324f-a374-4a46-8fc4-890e0e170433 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.184575 Jun 24 10:19:44.722195 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 231/452] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:44 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:44.852117 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:44.852874 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:44.860057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:44.860621 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:44.861419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:44.862050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.024170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:45.032574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f68ef3ba-df01-4e51-a3fb-b0aae3a7e090 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.186271 Jun 24 10:19:45.033142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 222/453] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:44 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:45.172868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:45.173874 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:45.174641 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:45.175488 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:45.181145 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.181878 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.182911 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.183502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.183650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.183948 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.184712 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.185329 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.415357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:45.419436 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:45.425331 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:45.428547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e7e69ecf-f471-4ece-8d0a-0cea2415d74c tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1504 microversion: 2.1 time: 0.257994 Jun 24 10:19:45.429670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 223/454] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:45 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1504 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:45.444601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:45.446083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:45.447279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-660ad6ed-1adf-4233-af27-19f4c0128ada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.278809 Jun 24 10:19:45.447840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 232/455] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:45 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:45.643522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-ce4c6d86-31a3-474d-a9a5-0117126adb67 req-b2855828-a1b9-4b44-b087-437eeb827d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf", "name": "network-vif-deleted", "tag": "8d7ed742-d658-41ac-bf26-1bddaf55fa57"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:45.651944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-ce4c6d86-31a3-474d-a9a5-0117126adb67 req-b2855828-a1b9-4b44-b087-437eeb827d8d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.652386 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-ce4c6d86-31a3-474d-a9a5-0117126adb67 req-b2855828-a1b9-4b44-b087-437eeb827d8d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.663393 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-ce4c6d86-31a3-474d-a9a5-0117126adb67 req-b2855828-a1b9-4b44-b087-437eeb827d8d service nova] Creating event network-vif-deleted:8d7ed742-d658-41ac-bf26-1bddaf55fa57 for instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf on hv-cinder-84713 Jun 24 10:19:45.668321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-ce4c6d86-31a3-474d-a9a5-0117126adb67 req-b2855828-a1b9-4b44-b087-437eeb827d8d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028596 Jun 24 10:19:45.668888 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 224/456] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:45.739947 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:45.740847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:45.747629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.748075 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.748836 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:45.749266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:45.879359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:45.887649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9a7062ed-0050-49ea-bed6-d13837ea2899 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.151955 Jun 24 10:19:45.888217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 233/457] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:45 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:46.051883 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:46.052806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:46.060172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.060627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.061411 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.061845 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.424648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:46.432954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b952769e-8b1d-4c74-ba85-701a10464597 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.386779 Jun 24 10:19:46.443191 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 225/458] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:46 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:46.448975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:46.449747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:46.456092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.456600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.457386 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.457822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.473996 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:46.475114 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:46.487228 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.488015 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.489004 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.489610 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.510013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.511647 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.513284 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lazy-loading 'fault' on Instance uuid 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:19:46.584722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '516e13cf120a461d8632844453635fa9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8a290c7de54fb892f408f3d4f1e657', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:46.598351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b229d182-a581-4bef-ab52-1b9c25dddd7d tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 200 len: 1304 microversion: 2.1 time: 0.153042 Jun 24 10:19:46.599316 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 234/459] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:46 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 1304 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:46.655687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:46.664935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:46.666878 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:46.668330 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-00faf0fc-4070-4c52-b680-171dda9a08e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.205799 Jun 24 10:19:46.668985 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 226/460] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:46 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:46.905088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:46.905870 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:46.913464 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.913914 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:46.914681 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:46.915143 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.073921 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:47.082088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a04c9136-e6c0-46a5-b759-4a09985cfb85 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.181126 Jun 24 10:19:47.082673 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 235/461] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:46 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:47.457882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:47.459015 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:47.468049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:47.468800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.470082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:47.470821 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.606462 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:47.614481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d06032c5-4194-4934-828f-78f972b41343 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.168078 Jun 24 10:19:47.615358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 227/462] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:47 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:47.620655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:47.621403 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] [instance: 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:47.627634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:47.628075 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.628824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:47.629251 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.643555 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] HTTP exception thrown: Instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf could not be found. Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Request method failure captured: Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf HTTP/1.1 Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY-NB01ZYAGdEnHoWZ45vvP-q8rP0-SlbpjzADMbA8QotzU6-JXgtol4-agmt_-YmKSVN7TjONGrj5dO-YAxfo4GAJ5eXLCCgNHY8CMgqYlMiIpUWQhj76PNY7sSdfKY0KwjlMb_PgUSCjvQuffPobFyS4DpisQGPdhcMlgRs2xg-9s Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 4a8a290c7de54fb892f408f3d4f1e657 Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesActionsTest-1713171782 Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:19:47.645198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/4a8a290c7de54fb892f408f3d4f1e657"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_4a8a290c7de54fb892f408f3d4f1e657", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4a8a290c7de54fb892f408f3d4f1e657"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/4a8a290c7de54fb892f408f3d4f1e657"}]}] Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesActionsTest-1713171782 Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 4a8a290c7de54fb892f408f3d4f1e657 Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesActionsTest-1713171782 Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesActionsTest-1713171782-project Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 516e13cf120a461d8632844453635fa9 Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesActionsTest-1713171782-project Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf could not be found. Jun 24 10:19:47.646691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf'} Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf could not be found. Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:19:47.647608 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf could not be found. Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf could not be found. Jun 24 10:19:47.649018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:47.650375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] Returning 404 to user: Instance 8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:19:47.650375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c6cf9e76-dffb-4c39-8750-79ce5783bbd5 tempest-VolumesActionsTest-1713171782 tempest-VolumesActionsTest-1713171782-project] 10.222.0.64 "GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf" status: 404 len: 111 microversion: 2.1 time: 0.029809 Jun 24 10:19:47.650375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 236/463] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:47 2022] GET /compute/v2.1/servers/8e1a0ac5-1ebb-49ce-b1b5-2485c1dcc2cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:19:47.688178 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:47.689011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:47.701891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:47.702305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.702974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:47.707521 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:47.843595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:47.853177 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:47.854717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:47.855887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-60ebe92a-6100-4026-b097-e9f3a4dacb09 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.172289 Jun 24 10:19:47.856436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 228/464] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:47 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:48.102010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:48.102010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:48.108643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.109101 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:48.109879 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.110472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:48.111276 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-7b1a135b-a419-472c-9a38-de0482928447 req-222ece76-330f-4433-b8a3-ecacf73cdeb8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "name": "network-vif-plugged", "status": "completed", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:48.121911 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-7b1a135b-a419-472c-9a38-de0482928447 req-222ece76-330f-4433-b8a3-ecacf73cdeb8 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.123583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-7b1a135b-a419-472c-9a38-de0482928447 req-222ece76-330f-4433-b8a3-ecacf73cdeb8 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:48.153886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-7b1a135b-a419-472c-9a38-de0482928447 req-222ece76-330f-4433-b8a3-ecacf73cdeb8 service nova] Creating event network-vif-plugged:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:19:48.162779 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-7b1a135b-a419-472c-9a38-de0482928447 req-222ece76-330f-4433-b8a3-ecacf73cdeb8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061711 Jun 24 10:19:48.164074 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 229/465] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:19:48.261410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:48.269634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-97404ca0-7076-4e9a-a3d9-6d945c243cb7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1735 microversion: 2.1 time: 0.172685 Jun 24 10:19:48.270210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 237/466] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:48 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:48.633958 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:48.634839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:48.642753 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.643329 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:48.644225 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.644739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:48.783008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:48.791670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b98f093e-095e-44d8-a0f2-49d777924909 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.163423 Jun 24 10:19:48.792264 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 230/467] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:48 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:48.878144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:48.879209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:48.886771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.887168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:48.887908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:48.888370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.032674 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:49.041364 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:49.042905 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:49.044064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-21ff7025-d2ab-4183-a4bf-039a9630df4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.171917 Jun 24 10:19:49.044654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 238/468] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:48 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:49.291918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:49.292810 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:49.303241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.303720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.304514 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.304947 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.440012 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:49.449367 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-16d5314e-9340-4f59-a343-d3d0f4c89f3a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1715 microversion: 2.1 time: 0.164636 Jun 24 10:19:49.449939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 231/469] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:49 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1715 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:49.558517 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:49.559214 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:49.565632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.566071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.566863 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.567290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.703706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] HTTP exception thrown: Cannot 'detach_volume' instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 while it is in vm_state rescued Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Request method failure captured: Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments/40a1b858-85ea-4441-869b-b0439e139797 HTTP/1.1 Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY744HRlPwP1EIqX0GnCPfWiw1q2DHeFzAttpSa3JDrD9vQCDI08IByFUd2W_kKKI3BrhLnEkXaQWNYhq-0Kmbp8gShZJztR5orPAhaHKtC7j6GN3pxS4zg4V79aNjZwRpLSZEK-WaPohZHtTHB87W2BhfrBjbj3UUTOUqMU6S7cVLg Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:19:49.705230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_172381cd65a94b1fa2939d6af673f6ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}] Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: acbafaab99f848828c304ca5a45a55dc Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:19:49.706756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Cannot 'detach_volume' instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 while it is in vm_state rescued Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'server_id': '89570c7f-aa48-4b00-8f01-4db37fae4d62', 'id': '40a1b858-85ea-4441-869b-b0439e139797'} Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:19:49.707771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 while it is in vm_state rescued Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 while it is in vm_state rescued Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:19:49.709876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Returning 409 to user: Cannot 'detach_volume' instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 while it is in vm_state rescued {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:19:49.711203 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4fcd9c84-8eb6-4395-bab8-769a68fca83a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments/40a1b858-85ea-4441-869b-b0439e139797" status: 409 len: 152 microversion: 2.1 time: 0.152213 Jun 24 10:19:49.711203 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 239/470] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:19:49 2022] DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments/40a1b858-85ea-4441-869b-b0439e139797 => generated 152 bytes in 153 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 24 10:19:49.716952 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:49.717487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:49.724407 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.725464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.726234 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.726666 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.767999 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:49.798881 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a86ad4a1-4e0a-4576-afec-2b8bf5b53a90 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "POST /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/action" status: 202 len: 0 microversion: 2.1 time: 0.086279 Jun 24 10:19:49.802456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 232/471] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:19:49 2022] POST /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:19:49.807888 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:49.808119 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:49.808486 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:49.808806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:49.815167 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.815328 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.815620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.815730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.816384 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.816524 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:49.816801 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:49.816930 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:50.009776 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:50.013840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:50.018099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d5b5756a-f6b4-4a17-be7a-b12c82d4d7ba tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1723 microversion: 2.1 time: 0.214131 Jun 24 10:19:50.018729 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 240/472] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:49 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1723 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:50.021924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2bfb8616-be05-4e0a-a814-1749aff477bc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.217385 Jun 24 10:19:50.022494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 233/473] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:49 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:50.062835 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:50.063376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:50.070025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:50.070465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:50.071253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:50.071673 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:50.208294 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:50.218063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:50.219629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:50.220763 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-bd1d23cc-4dc0-4ec0-a6d5-f68e075da7d8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.161998 Jun 24 10:19:50.221305 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 241/474] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:50 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:19:51.040894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:51.041946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:51.042308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:51.043370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:51.053162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:51.053819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:51.053990 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:51.054333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:51.054608 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:51.055078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:51.055243 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:51.055555 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:51.247652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:51.252254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:51.258384 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-732a48e9-6d8e-4f92-ae7a-db49a0bd07f1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1723 microversion: 2.1 time: 0.224946 Jun 24 10:19:51.258972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 234/475] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:51 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:51.261830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-74ab13cb-3497-40e5-8ebc-4e4bd89c52de tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.225931 Jun 24 10:19:51.262544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 242/476] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:51 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:51.263908 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:51.264511 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:51.270388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:51.271006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:51.271873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:51.272310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:51.424940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:51.434025 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:51.435560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:51.436746 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5320d09a-8504-47f1-b0bc-8ec69aadf332 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.176868 Jun 24 10:19:51.437303 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 235/477] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:51 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:52.276968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:52.277596 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:52.279644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:52.280310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:52.284217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:52.284748 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:52.285551 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:52.286127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:52.290016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:52.290962 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:52.291730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:52.292160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:52.485111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:52.495673 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3a226cfc-df9d-43be-b630-a46871b37563 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1723 microversion: 2.1 time: 0.223005 Jun 24 10:19:52.496926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 243/478] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:52 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:52.501823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:52.503257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:52.504485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:52.509978 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7b1c2d50-54e5-40ce-974c-864bf11a1e42 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.235476 Jun 24 10:19:52.510888 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 236/479] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:52 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:52.513032 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:52.513483 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:52.514286 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:52.514737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:52.666731 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:52.675062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:52.676549 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:52.677798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-93aaa505-a64d-418c-9b30-04f649dd4b11 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.179642 Jun 24 10:19:52.678450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 244/480] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:52 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:53.080347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-2d2b63df-b3de-4053-a007-f9583a2fedfb req-8f7f05d9-6731-4fc4-81ce-a287e6d470c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "name": "network-vif-plugged", "status": "completed", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:53.094334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2d2b63df-b3de-4053-a007-f9583a2fedfb req-8f7f05d9-6731-4fc4-81ce-a287e6d470c9 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.095087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2d2b63df-b3de-4053-a007-f9583a2fedfb req-8f7f05d9-6731-4fc4-81ce-a287e6d470c9 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:53.110498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-2d2b63df-b3de-4053-a007-f9583a2fedfb req-8f7f05d9-6731-4fc4-81ce-a287e6d470c9 service nova] Creating event network-vif-plugged:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:19:53.116678 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-2d2b63df-b3de-4053-a007-f9583a2fedfb req-8f7f05d9-6731-4fc4-81ce-a287e6d470c9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044795 Jun 24 10:19:53.118662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 237/481] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:53.513402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:53.514907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:53.524166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.524622 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:53.525590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.526195 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:53.532747 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:53.534059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:53.540758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.541470 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:53.542472 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.543245 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:53.758491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:53.767653 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-41357d1c-00b8-4bfe-a2a8-4c295f23d5da tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.243320 Jun 24 10:19:53.768451 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 238/482] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:53 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:19:53.772706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:53.781814 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:53.782807 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:53.782943 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4b06dc00-db89-4cc2-ba37-f9fe62dc3b10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1723 microversion: 2.1 time: 0.273410 Jun 24 10:19:53.792818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 245/483] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:53 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:53.799783 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.800399 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:53.801425 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:53.801969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:54.000708 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:54.011727 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:54.013231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:54.014571 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-712c5a21-f948-4689-919b-1a1a2b0c2f48 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.244666 Jun 24 10:19:54.015211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 239/484] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:53 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:54.788888 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:54.790190 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:54.799350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:54.799879 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:54.800778 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:54.801556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:54.802082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:54.803133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:54.813083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:54.813999 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:54.817201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:54.819980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:55.107855 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:55.110294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:55.120310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-14c37972-e3cd-4639-9be4-40313a09fafb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1723 microversion: 2.1 time: 0.321961 Jun 24 10:19:55.120969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 240/485] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:54 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1723 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:55.126335 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:55.127158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:55.135180 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:55.136416 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:55.137374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:55.137661 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a4a0c131-2c56-4799-a116-d0c15155ee7a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.353414 Jun 24 10:19:55.138126 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:55.147960 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 246/486] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:54 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:55.299560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:55.310928 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:55.312678 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:55.314024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-95cded13-2cb2-43e3-a590-712e9bf46106 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1809 microversion: 2.20 time: 0.191792 Jun 24 10:19:55.314775 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 241/487] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:55 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1809 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:56.138718 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:56.139473 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:56.146925 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.147655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.149902 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.149902 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.157636 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:56.158439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:56.172856 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.173723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.175572 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.178576 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.343001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:56.352417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-70c18438-9919-47ab-9d53-7516f168e841 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1729 microversion: 2.1 time: 0.218010 Jun 24 10:19:56.353876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 247/488] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:56 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1729 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:56.358799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:56.359711 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:56.366566 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.367397 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.368442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.369087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.387816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:56.397132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-235551cd-948d-49ae-ab13-c1d673143e17 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.245408 Jun 24 10:19:56.397627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 242/489] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:56 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:56.402550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:56.403334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:56.416507 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.417928 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.419844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:56.421629 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:56.576500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6faf533f-7c23-4cfa-8002-6e0a1ac7442a tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.177542 Jun 24 10:19:56.577711 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 243/490] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:19:56 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-interface => generated 284 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:56.629602 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:56.645298 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:56.647325 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:56.649061 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0b6affde-7b48-4069-aea4-932dbbf06f15 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1796 microversion: 2.20 time: 0.293838 Jun 24 10:19:56.650833 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 248/491] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:19:56 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1796 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:19:57.413895 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:57.415363 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:57.424263 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:57.425151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:57.426097 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:57.426679 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:57.613102 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:57.623584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8d8698af-f7af-4d0c-91dd-bc6b480d8547 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1261 microversion: 2.1 time: 0.213639 Jun 24 10:19:57.625135 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 244/492] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:57 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1261 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:57.684460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-b4b8e8bb-f4a9-4049-9b28-b57b6983e5e8 req-943f0398-5b77-44dc-8400-dfdca9a54950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89570c7f-aa48-4b00-8f01-4db37fae4d62", "tag": "68d3c446-3f13-44e3-a64e-32cfa07544ad"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:57.699734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b4b8e8bb-f4a9-4049-9b28-b57b6983e5e8 req-943f0398-5b77-44dc-8400-dfdca9a54950 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:57.700556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b4b8e8bb-f4a9-4049-9b28-b57b6983e5e8 req-943f0398-5b77-44dc-8400-dfdca9a54950 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:57.716690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-b4b8e8bb-f4a9-4049-9b28-b57b6983e5e8 req-943f0398-5b77-44dc-8400-dfdca9a54950 service nova] Creating event network-changed:68d3c446-3f13-44e3-a64e-32cfa07544ad for instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 on hv-cinder-84713 Jun 24 10:19:57.721833 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-b4b8e8bb-f4a9-4049-9b28-b57b6983e5e8 req-943f0398-5b77-44dc-8400-dfdca9a54950 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043101 Jun 24 10:19:57.722429 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 249/493] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:19:58.645533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:58.652769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:58.667127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:58.667127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:58.667127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:58.667518 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:58.842855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:58.850618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c4c7fd72-a702-40b7-9594-f7db938b1cf4 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1445 microversion: 2.1 time: 0.212455 Jun 24 10:19:58.851523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 245/494] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:58 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1445 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:58.868475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:19:58.869191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:19:58.876019 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:58.876470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:58.877240 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:58.877669 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:58.897046 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:19:59.023513 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:19:59.031908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5b641cf0-14b6-46a9-b508-03c7a4aaf1fb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1445 microversion: 2.1 time: 0.168165 Jun 24 10:19:59.032563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 250/495] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:19:58 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1445 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:19:59.781504 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-6e3d7e8a-b54e-4867-876e-d33c9fcb4a7c req-06db3c1f-1540-44af-af7f-bc5ceb2f7ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "89570c7f-aa48-4b00-8f01-4db37fae4d62", "tag": "68d3c446-3f13-44e3-a64e-32cfa07544ad"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:19:59.812407 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-6e3d7e8a-b54e-4867-876e-d33c9fcb4a7c req-06db3c1f-1540-44af-af7f-bc5ceb2f7ef6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:19:59.814988 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-6e3d7e8a-b54e-4867-876e-d33c9fcb4a7c req-06db3c1f-1540-44af-af7f-bc5ceb2f7ef6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:19:59.829121 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-6e3d7e8a-b54e-4867-876e-d33c9fcb4a7c req-06db3c1f-1540-44af-af7f-bc5ceb2f7ef6 service nova] Creating event network-changed:68d3c446-3f13-44e3-a64e-32cfa07544ad for instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 on hv-cinder-84713 Jun 24 10:19:59.835987 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-6e3d7e8a-b54e-4867-876e-d33c9fcb4a7c req-06db3c1f-1540-44af-af7f-bc5ceb2f7ef6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061216 Jun 24 10:19:59.836938 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 246/496] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:20:01.935449 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-5af3d0cb-ed64-4157-98dc-fd0a5f3e4eb0 req-78cc905c-14c6-46ea-9204-b7ab3a8fd4ce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:01.949662 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-5af3d0cb-ed64-4157-98dc-fd0a5f3e4eb0 req-78cc905c-14c6-46ea-9204-b7ab3a8fd4ce service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:01.950342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-5af3d0cb-ed64-4157-98dc-fd0a5f3e4eb0 req-78cc905c-14c6-46ea-9204-b7ab3a8fd4ce service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:01.966205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-5af3d0cb-ed64-4157-98dc-fd0a5f3e4eb0 req-78cc905c-14c6-46ea-9204-b7ab3a8fd4ce service nova] Creating event network-changed:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:20:01.972780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-5af3d0cb-ed64-4157-98dc-fd0a5f3e4eb0 req-78cc905c-14c6-46ea-9204-b7ab3a8fd4ce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041102 Jun 24 10:20:01.974687 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 251/497] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:11.708401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:11.708401 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:11.710274 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.710947 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=76,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:11.718591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:11.719288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:11.720110 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:11.720566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:11.858731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lazy-loading 'services' on Instance uuid e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:20:11.975842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6263f01e-fc46-4641-9835-658d9cc6f0fa tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-volume_attachments/da7f66de-aadb-439e-8f0d-83cd7d6c7670" status: 202 len: 0 microversion: 2.1 time: 0.273587 Jun 24 10:20:11.976457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 247/498] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:20:11 2022] DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-volume_attachments/da7f66de-aadb-439e-8f0d-83cd7d6c7670 => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:20:13.115025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c3bf324b-51a6-4e06-886f-39b7e6fdf712 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:13.117923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=75 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.118566 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=4 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:13.124532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c3bf324b-51a6-4e06-886f-39b7e6fdf712 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:13.125003 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c3bf324b-51a6-4e06-886f-39b7e6fdf712 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:13.185887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c3bf324b-51a6-4e06-886f-39b7e6fdf712 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Going to try to stop instance {{(pid=117854) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 24 10:20:13.234109 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c3bf324b-51a6-4e06-886f-39b7e6fdf712 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.123288 Jun 24 10:20:13.234765 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 252/499] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:20:13 2022] POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:20:13.246500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:13.247367 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:13.254134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:13.254591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:13.255392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:13.255826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:13.397288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:13.405547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-05ffba29-b111-4357-b973-dc6e2e07ea9b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.165507 Jun 24 10:20:13.406113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 248/500] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:13 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:14.430027 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:14.430722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:14.437187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:14.437636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:14.438400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:14.438873 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:14.571006 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:14.578724 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e22ea820-2bf7-4be1-9d64-8d6ee9d232db tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.153708 Jun 24 10:20:14.579288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 253/501] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:14 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:20:15.597698 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:15.598358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:15.605515 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:15.605959 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:15.606741 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:15.607181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:15.740890 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:15.748967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-890c2b18-c2d3-410e-94d6-8f123231747d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.155423 Jun 24 10:20:15.749545 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 249/502] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:15 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:16.766370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:16.766984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:16.773827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:16.774265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:16.775049 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:16.775475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:16.920987 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:16.931552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-348339e8-c46e-4f91-9b2b-4fe3f430c250 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.168939 Jun 24 10:20:16.932429 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 254/503] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:16 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:20:17.948568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:17.949255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:17.957394 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:17.957889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:17.958985 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:17.959666 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:18.114591 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:18.122927 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-678f2aad-f25a-44f3-986d-9739ff8c25c5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.178264 Jun 24 10:20:18.123528 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 250/504] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:17 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:19.139422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:19.140089 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:19.147058 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:19.147491 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:19.148252 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:19.148687 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:19.287625 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:19.297046 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9cc743a3-63aa-4adb-acc0-057aac04f559 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.161853 Jun 24 10:20:19.298171 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 255/505] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:19 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:20.318673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:20.319644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:20.329080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:20.329529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:20.330289 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:20.330738 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:20.461379 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:20.470037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f74ab0d6-8c22-4527-bf72-eae0d556676e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.157906 Jun 24 10:20:20.470595 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 251/506] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:20 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:21.491172 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:21.492257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:21.504281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:21.504722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:21.505525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:21.505946 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:21.647432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:21.655651 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d9a27cf6-12b2-4dd9-8ab7-ec68292b6471 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.170901 Jun 24 10:20:21.656211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 256/507] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:21 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:22.675331 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:22.676022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:22.686325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:22.687198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:22.698332 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:22.698974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:22.851690 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:22.863378 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c63dea62-29db-4c03-9ff0-b1bdff4a55b1 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1675 microversion: 2.1 time: 0.192947 Jun 24 10:20:22.864086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 252/508] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:22 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1675 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:23.883804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:23.884448 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:23.891624 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:23.892064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:23.892814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:23.893236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.032012 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:24.039620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5f71d1a4-2790-4859-83cd-f3f08ebf43a6 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1652 microversion: 2.1 time: 0.159603 Jun 24 10:20:24.040164 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 257/509] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:23 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1652 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:24.056910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-27e88ce5-027c-4adf-a6a4-1105198d3bd7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:24.063719 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-27e88ce5-027c-4adf-a6a4-1105198d3bd7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.064186 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-27e88ce5-027c-4adf-a6a4-1105198d3bd7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.090452 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-27e88ce5-027c-4adf-a6a4-1105198d3bd7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Going to try to start instance {{(pid=117855) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 24 10:20:24.141055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-27e88ce5-027c-4adf-a6a4-1105198d3bd7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action" status: 202 len: 0 microversion: 2.1 time: 0.087969 Jun 24 10:20:24.142388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 253/510] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:20:24 2022] POST /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:20:24.150571 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:24.151209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:24.160474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.161354 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.162336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:24.162957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:24.318956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:24.326948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f7a76b04-aa0e-480f-b77c-4942966a3b72 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1661 microversion: 2.1 time: 0.180030 Jun 24 10:20:24.328776 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 258/511] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:24 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1661 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:25.345777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:25.346479 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:25.352795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:25.355414 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:25.356269 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:25.356715 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:25.500769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:25.508634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a03f446d-fc0f-4ddf-ba36-18b0b734cf92 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1661 microversion: 2.1 time: 0.167669 Jun 24 10:20:25.509129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 254/512] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:25 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1661 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:26.525691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:26.526435 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:26.533037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:26.533494 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:26.534254 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:26.534935 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:26.678553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:26.689711 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0b12bc74-317c-48df-b070-f34d84e1520a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1665 microversion: 2.1 time: 0.167680 Jun 24 10:20:26.690572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 259/513] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:26 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:38.509584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:38.510293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:38.513134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=16 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.513979 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.520436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.520888 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.521651 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.522100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.552416 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-af8872f5-69eb-4017-9be9-43d1c8b1839f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments/fd3faf5d-5acf-4769-862a-443e3bca75a4" status: 200 len: 194 microversion: 2.20 time: 0.048878 Jun 24 10:20:38.553008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 255/514] 10.222.0.64 () {60 vars in 1453 bytes} [Fri Jun 24 10:20:38 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments/fd3faf5d-5acf-4769-862a-443e3bca75a4 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:38.618848 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:38.619361 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:38.624020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=16 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.624729 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:38.628707 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.629222 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.629990 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.630418 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.718322 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lazy-loading 'services' on Instance uuid cb96a476-856a-400c-8c57-30b98297ebee {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:20:38.846975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3dcfdee0-1d02-48b5-8af6-2daac76aa8da tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments/fd3faf5d-5acf-4769-862a-443e3bca75a4" status: 202 len: 0 microversion: 2.20 time: 0.231874 Jun 24 10:20:38.847503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 260/515] 10.222.0.64 () {60 vars in 1456 bytes} [Fri Jun 24 10:20:38 2022] DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments/fd3faf5d-5acf-4769-862a-443e3bca75a4 => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:38.856400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:38.857447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:38.864960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.865409 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.866167 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:38.866615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:38.898113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-966c0328-e126-422a-8e15-a59ba581b210 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045743 Jun 24 10:20:38.898669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 256/516] 10.222.0.64 () {60 vars in 1342 bytes} [Fri Jun 24 10:20:38 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:20:39.911739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:39.912734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:39.919618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:39.920064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:39.921028 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:39.921341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:39.952227 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-08197d70-373d-454b-896e-56b51f1c0f57 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.045242 Jun 24 10:20:39.952970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 261/517] 10.222.0.64 () {60 vars in 1342 bytes} [Fri Jun 24 10:20:39 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:40.020525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:40.021043 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:40.027882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:40.028341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:40.029109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:40.029548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:40.058092 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:20:40.140321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ba99057a-5d27-42ba-9057-280254896cf6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 204 len: 0 microversion: 2.20 time: 0.123620 Jun 24 10:20:40.140898 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 257/518] 10.222.0.64 () {60 vars in 1279 bytes} [Fri Jun 24 10:20:40 2022] DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:20:40.149904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:40.150499 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:40.156562 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:40.156998 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:40.157739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:40.158162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:40.291300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:40.299428 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:40.300886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:40.302027 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-99871094-2939-4c01-ae14-e7709900455f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.156188 Jun 24 10:20:40.302545 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 262/519] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:40 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:20:41.326366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:41.327519 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:41.338418 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:41.339620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:41.340877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:41.341596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:41.483418 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:41.495534 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:41.497818 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:41.499475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b0dd9b69-e36a-4aee-b653-f4589e32e4a3 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.180332 Jun 24 10:20:41.500125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 258/520] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:41 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:42.519686 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:42.520250 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:42.526739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:42.527201 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:42.527951 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:42.528373 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:42.671976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:42.680211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:42.681711 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:42.682901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-16fba845-d120-4db0-8fc8-0515141c1633 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1724 microversion: 2.20 time: 0.167876 Jun 24 10:20:42.683453 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 263/521] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:42 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:43.237039 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-12fdb366-67ad-4e4e-ba6d-65589dafd6df req-b0d41966-952e-47dd-bef1-df8d3b995847 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb96a476-856a-400c-8c57-30b98297ebee", "name": "network-vif-deleted", "tag": "0c384c38-8450-4bcf-a60e-98848c87017b"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:43.247156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-12fdb366-67ad-4e4e-ba6d-65589dafd6df req-b0d41966-952e-47dd-bef1-df8d3b995847 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:43.247903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-12fdb366-67ad-4e4e-ba6d-65589dafd6df req-b0d41966-952e-47dd-bef1-df8d3b995847 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:43.260031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-12fdb366-67ad-4e4e-ba6d-65589dafd6df req-b0d41966-952e-47dd-bef1-df8d3b995847 service nova] Creating event network-vif-deleted:0c384c38-8450-4bcf-a60e-98848c87017b for instance cb96a476-856a-400c-8c57-30b98297ebee on hv-cinder-84713 Jun 24 10:20:43.265343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-12fdb366-67ad-4e4e-ba6d-65589dafd6df req-b0d41966-952e-47dd-bef1-df8d3b995847 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032053 Jun 24 10:20:43.266258 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 259/522] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:43.702153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:43.702894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:43.718225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:43.720000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:43.721277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:43.722806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:43.763058 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:43.763501 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:43.763957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lazy-loading 'fault' on Instance uuid cb96a476-856a-400c-8c57-30b98297ebee {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:20:43.825622 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:43.834672 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:43.837135 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:43.838519 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f0162af3-3351-4a07-8369-94d1d92e4048 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 200 len: 1371 microversion: 2.20 time: 0.141071 Jun 24 10:20:43.839969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 264/523] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:43 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 1371 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:44.862794 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:44.863494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:44.870235 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:44.870680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:44.871478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:44.871912 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:44.885744 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] HTTP exception thrown: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Request method failure captured: Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee HTTP/1.1 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY7vtRfp9yCzJORBUJhhyOReAESustvc57KyjM9a744o7lC90Xg0I1S7plCxGjOXLh6nsKquYR5VVgo4atChBMC8zsglKMCQpOHP6cPWvDveD-Pgg1LswyosxuTzLMXkwOU9A-eJjhWmrmbk2UHq-tqqdTZtngG7d9zzET_9LwH6A98 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:20:44.887434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_74111042535d44c8a52a4656eb37fa23", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}] Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 0a66b13572904a309d3180afc7278070 Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:20:44.889587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'cb96a476-856a-400c-8c57-30b98297ebee'} Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:20:44.891080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:20:44.892839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:20:44.894442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Returning 404 to user: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:20:44.894442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d3893352-47b7-4331-beef-0f6ea8f2e0a7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 404 len: 111 microversion: 2.20 time: 0.032485 Jun 24 10:20:44.894442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 260/524] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:44 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:20:44.899839 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f58f3597-3591-485d-ba74-ae16d724b749 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '.version_select at 0x7f3774b31040>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:44.926796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f58f3597-3591-485d-ba74-ae16d724b749 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588499818" status: 204 len: 0 microversion: 2.20 time: 0.032409 Jun 24 10:20:44.927382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 265/525] 10.222.0.64 () {60 vars in 1261 bytes} [Fri Jun 24 10:20:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1588499818 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:20:45.520977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:45.521472 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:45.527723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:45.528428 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:45.529223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:45.529646 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:45.621875 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lazy-loading 'services' on Instance uuid 89570c7f-aa48-4b00-8f01-4db37fae4d62 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:20:45.651231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-083bb110-5c2d-4f34-8f8d-e262f3d4a522 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'create', calling method: .version_select at 0x7f3774b9dee0>, body: {"keypair": {"name": "tempest-keypair-1376698504", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJSFRrhUhGhiqqmv3iIWr1tSmGfrJmEXMpNoLdrZ+qYyIxxUuMy+XuIe12HDUWop4PiQrB0Bul4begogvq7JJ5ebUKHXCdJwWKcijjXWUqtw06UWZ37iHQcb94S8mDc7XQ=="}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:45.666376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-083bb110-5c2d-4f34-8f8d-e262f3d4a522 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for project 74111042535d44c8a52a4656eb37fa23. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:20:45.670402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-083bb110-5c2d-4f34-8f8d-e262f3d4a522 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for user 0a66b13572904a309d3180afc7278070 and project 74111042535d44c8a52a4656eb37fa23. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:20:45.695963 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-083bb110-5c2d-4f34-8f8d-e262f3d4a522 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048659 Jun 24 10:20:45.696561 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 266/526] 10.222.0.64 () {62 vars in 1199 bytes} [Fri Jun 24 10:20:45 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 24 10:20:45.701817 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3dcd76d0-1350-4d87-9ab3-5706364005b7 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments/40a1b858-85ea-4441-869b-b0439e139797" status: 202 len: 0 microversion: 2.1 time: 0.185429 Jun 24 10:20:45.702286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 261/527] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:20:45 2022] DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments/40a1b858-85ea-4441-869b-b0439e139797 => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:20:45.710880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:45.711811 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:45.718288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:45.718769 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:45.720590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:45.721042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:45.752350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7716902f-9cf6-4606-bfad-69bfbf00704f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044991 Jun 24 10:20:45.752958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 267/528] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:20:45 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:46.765257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:46.766326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:46.773282 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:46.773660 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:46.774433 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:46.775113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:46.805146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4ddb20fa-4bc4-458b-b6a8-c9d24a2c12ee tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044656 Jun 24 10:20:46.805714 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 262/529] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:20:46 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:20:46.888771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:46.889475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:46.897086 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:46.897625 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:46.898419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:46.898875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:46.931563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:20:47.022519 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3256e7fc-a6bb-4c5c-b955-db9c7ef2fc50 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 204 len: 0 microversion: 2.1 time: 0.137603 Jun 24 10:20:47.023380 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 268/530] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:20:46 2022] DELETE /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:47.031520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:47.032162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:47.038189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:47.038664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:47.039460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:47.039900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:47.056178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2048924237", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "77e0b315-c6f0-401c-b090-3f73b33dd671"}], "security_groups": [{"name": "tempest-securitygroup--1314037445"}], "key_name": "tempest-keypair-1376698504", "user_data": "}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:47.199964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] validate_networks() for [('77e0b315-c6f0-401c-b090-3f73b33dd671', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:20:47.204411 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:47.212614 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d26955af-95fb-4bda-9582-88365a21d507 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1689 microversion: 2.1 time: 0.184998 Jun 24 10:20:47.213189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 263/531] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:47 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1689 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:47.589770 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:20:47.590410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:20:47.591135 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:20:47.591701 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:20:47.592221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:20:47.606002 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:47.606611 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:47.607722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:47.608338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:47.626423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for project 74111042535d44c8a52a4656eb37fa23. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:20:47.630987 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Getting quotas for user 0a66b13572904a309d3180afc7278070 and project 74111042535d44c8a52a4656eb37fa23. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:20:47.643380 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:20:47.645710 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:20:47.701695 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c8e8b22c-8da1-4fef-90c6-87f2cec80983 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.650208 Jun 24 10:20:47.702760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 269/532] 10.222.0.64 () {62 vars in 1187 bytes} [Fri Jun 24 10:20:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jun 24 10:20:47.713432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f8995e84-fb01-4ea8-a92c-6317f5259375 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:47.714440 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f8995e84-fb01-4ea8-a92c-6317f5259375 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:47.771252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f8995e84-fb01-4ea8-a92c-6317f5259375 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:47.778444 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f8995e84-fb01-4ea8-a92c-6317f5259375 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:47.779986 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f8995e84-fb01-4ea8-a92c-6317f5259375 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:47.781094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f8995e84-fb01-4ea8-a92c-6317f5259375 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1282 microversion: 2.20 time: 0.071728 Jun 24 10:20:47.781841 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 264/533] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:47 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1282 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:48.234550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:48.235459 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:48.245097 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:48.245600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:48.246658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:48.247230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:48.389339 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:48.397512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-efce424d-7724-4f90-ad0b-50c6d7fe6292 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1689 microversion: 2.1 time: 0.167654 Jun 24 10:20:48.398060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 270/534] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:48 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1689 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:48.803877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:48.804842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:48.815769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:48.816211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:48.816976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:48.817407 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:48.885627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:48.893334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:48.897555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:48.897555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7766c5dd-2943-4fd9-896f-b474d4e998d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1286 microversion: 2.20 time: 0.098814 Jun 24 10:20:48.897555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 265/535] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:48 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1286 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:49.418780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:49.419832 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:49.431359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:49.432131 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:49.433357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:49.434082 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:49.786336 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:49.794853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d91a221e-ac78-4bc9-8a93-4b279eab4cfb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1689 microversion: 2.1 time: 0.382531 Jun 24 10:20:49.795712 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 271/536] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:49 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1689 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:49.914618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:49.915280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:49.921993 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:49.922445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:49.923242 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:49.923733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:49.985422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:49.993899 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:49.995473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:49.996574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a3a5ad94-dd69-451c-a012-a702cb6f9198 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1286 microversion: 2.20 time: 0.086012 Jun 24 10:20:49.997420 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 266/537] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:49 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1286 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:50.812805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:50.813384 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:50.835324 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:50.836649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:50.837653 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:50.838279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:51.001393 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:51.009484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b756749c-1133-47ff-b782-181a0acf7e10 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1689 microversion: 2.1 time: 0.200473 Jun 24 10:20:51.010776 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 272/538] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:50 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1689 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:51.019522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:51.020135 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:51.026520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:51.026999 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:51.027797 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:51.028187 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:51.107445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:51.119802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:51.121592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:51.123472 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-478c2aa2-e3a1-4650-92fb-e03b3a3e12a2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1340 microversion: 2.20 time: 0.111460 Jun 24 10:20:51.124162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 267/539] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:51 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1340 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:52.028492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:52.029148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:52.037886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:52.038335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:52.039197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:52.039917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:52.046271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-af9cd295-8964-4e92-8d6e-c46398d57089 req-5b4a21af-bcaf-4039-bdbd-6271f8072ad5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "89570c7f-aa48-4b00-8f01-4db37fae4d62", "name": "network-vif-deleted", "tag": "68d3c446-3f13-44e3-a64e-32cfa07544ad"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:52.070240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-af9cd295-8964-4e92-8d6e-c46398d57089 req-5b4a21af-bcaf-4039-bdbd-6271f8072ad5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:52.073492 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-af9cd295-8964-4e92-8d6e-c46398d57089 req-5b4a21af-bcaf-4039-bdbd-6271f8072ad5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:52.115502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-af9cd295-8964-4e92-8d6e-c46398d57089 req-5b4a21af-bcaf-4039-bdbd-6271f8072ad5 service nova] Creating event network-vif-deleted:68d3c446-3f13-44e3-a64e-32cfa07544ad for instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 on hv-cinder-84713 Jun 24 10:20:52.133966 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-af9cd295-8964-4e92-8d6e-c46398d57089 req-5b4a21af-bcaf-4039-bdbd-6271f8072ad5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090751 Jun 24 10:20:52.136554 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 268/540] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:52.152283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:52.153237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:52.170436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:52.171283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:52.173286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:52.174132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:52.312868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:52.323495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-aa358d23-3dfc-4856-a75e-aa6057e9cb98 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 200 len: 1621 microversion: 2.1 time: 0.299661 Jun 24 10:20:52.327435 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 273/541] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:52 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 1621 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:52.469449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:52.479945 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:52.484008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:52.487942 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e68aecf0-8bc8-4a3d-8792-e4e06aa2c42b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.341913 Jun 24 10:20:52.492486 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 269/542] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:52 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:20:53.342841 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:53.344467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 89570c7f-aa48-4b00-8f01-4db37fae4d62] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:53.360285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:53.362013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:53.363502 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:53.364182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:53.401588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] HTTP exception thrown: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 could not be found. Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Request method failure captured: Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 HTTP/1.1 Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY744HRlPwP1EIqX0GnCPfWiw1q2DHeFzAttpSa3JDrD9vQCDI08IByFUd2W_kKKI3BrhLnEkXaQWNYhq-0Kmbp8gShZJztR5orPAhaHKtC7j6GN3pxS4zg4V79aNjZwRpLSZEK-WaPohZHtTHB87W2BhfrBjbj3UUTOUqMU6S7cVLg Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:20:53.405205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_172381cd65a94b1fa2939d6af673f6ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}] Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: acbafaab99f848828c304ca5a45a55dc Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 could not be found. Jun 24 10:20:53.406593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '89570c7f-aa48-4b00-8f01-4db37fae4d62'} Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 could not be found. Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:20:53.407480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 could not be found. Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 could not be found. Jun 24 10:20:53.409016 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:20:53.410374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Returning 404 to user: Instance 89570c7f-aa48-4b00-8f01-4db37fae4d62 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:20:53.411552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-aebd46df-c9d3-45e9-8d0e-889ec6174c75 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62" status: 404 len: 111 microversion: 2.1 time: 0.073944 Jun 24 10:20:53.421727 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-cb8e7e9c-171f-41d4-9d2a-e3243f6af4b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '.version_select at 0x7f3774afedc0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:53.430795 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 274/543] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:53 2022] GET /compute/v2.1/servers/89570c7f-aa48-4b00-8f01-4db37fae4d62 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:20:53.457163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-cb8e7e9c-171f-41d4-9d2a-e3243f6af4b5 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109712094" status: 202 len: 0 microversion: 2.1 time: 0.039738 Jun 24 10:20:53.457842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 270/544] 10.222.0.64 () {58 vars in 1220 bytes} [Fri Jun 24 10:20:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2109712094 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:20:53.511791 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:53.512927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:53.522218 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:53.523252 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:53.524929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:53.525457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:54.015616 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:54.027253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:54.029078 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:54.030253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2c1480fd-cfd0-4807-8296-0f447964f985 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.524416 Jun 24 10:20:54.036037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 275/545] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:53 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:20:54.192733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-9400daf8-7b8c-456c-a98b-727577d5000d req-7a523cfb-0d2e-4ba9-9024-dd36216d0a5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:54.203107 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-9400daf8-7b8c-456c-a98b-727577d5000d req-7a523cfb-0d2e-4ba9-9024-dd36216d0a5b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:54.203539 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-9400daf8-7b8c-456c-a98b-727577d5000d req-7a523cfb-0d2e-4ba9-9024-dd36216d0a5b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:54.215866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-9400daf8-7b8c-456c-a98b-727577d5000d req-7a523cfb-0d2e-4ba9-9024-dd36216d0a5b service nova] Creating event network-changed:44c57577-b7f4-4772-ade3-5e9b2dded200 for instance 6a2ba100-192e-4c39-a43a-93be37df4e63 on hv-cinder-84713 Jun 24 10:20:54.223374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-9400daf8-7b8c-456c-a98b-727577d5000d req-7a523cfb-0d2e-4ba9-9024-dd36216d0a5b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034559 Jun 24 10:20:54.227059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 271/546] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:20:55.051622 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:55.052789 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:55.066209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:55.066966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:55.069340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:55.070197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:55.298805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:55.310651 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:55.317026 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:55.318553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c6d9c282-53f9-48bc-9b8c-d336d5269e85 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.271704 Jun 24 10:20:55.320603 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 276/547] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:55 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:56.339642 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:56.340339 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:56.347052 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:56.347567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:56.348371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:56.348816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:56.595764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:56.609320 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:56.612234 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:56.613524 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b1e9b2fd-e769-4c8a-b30a-109eb5d2d634 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.279577 Jun 24 10:20:56.614396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 272/548] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:56 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:56.842591 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:56.843957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:56.852092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:56.853682 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:56.854926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:56.855586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:56.869999 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:56.898924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:20:57.003798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a2f1d34c-234b-472b-b0c4-552c206092e9 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "DELETE /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 204 len: 0 microversion: 2.1 time: 0.164736 Jun 24 10:20:57.010002 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 277/549] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:20:56 2022] DELETE /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:20:57.016663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:57.017550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:57.035792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:57.036365 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:57.037301 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:57.041422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:57.272336 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:57.276154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:57.281447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-28b5a2da-94ad-4aa8-882a-5308eb9088bd tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1508 microversion: 2.1 time: 0.270857 Jun 24 10:20:57.282024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 273/550] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:57 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1508 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:57.635355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:57.636374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:57.642917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:57.643741 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=10 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:57.650187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:57.651344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:57.652563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:57.653456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:57.826401 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:57.835838 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:57.837705 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:57.839460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4c237b3f-91df-4783-9b36-3fcc3f8a2b07 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.210465 Jun 24 10:20:57.840153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 278/551] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:57 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:58.300766 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:58.302044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:58.311693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:20:58.315226 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:58.315971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:58.317190 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:58.317918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:58.541546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:58.550409 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-54f5b34d-06b9-4c41-b0b6-8a2c9d0e930f tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1508 microversion: 2.1 time: 0.254884 Jun 24 10:20:58.551679 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 274/552] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:58 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1508 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:58.863636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:58.865525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:58.874398 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:58.875404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:58.876268 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:58.877015 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:59.072211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:59.090615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:59.091007 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:59.092737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0b7b52a1-735b-4b83-9384-7efe580f1783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.237014 Jun 24 10:20:59.103431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 279/553] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:20:58 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:20:59.569018 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:20:59.569639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:20:59.576838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:59.578210 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:59.579022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:59.579454 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:59.769921 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:20:59.780708 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-91790a93-9522-4ba1-bc3e-37196f5fe4e1 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1508 microversion: 2.1 time: 0.216130 Jun 24 10:20:59.800133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 275/554] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:20:59 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1508 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:20:59.833271 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-6994dd91-7f54-41e3-b793-f8b0a8aba93e req-7285cc5a-7307-42f5-ade3-44a247ce4ced service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "name": "network-vif-plugged", "status": "completed", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:20:59.845018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-6994dd91-7f54-41e3-b793-f8b0a8aba93e req-7285cc5a-7307-42f5-ade3-44a247ce4ced service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:20:59.845503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-6994dd91-7f54-41e3-b793-f8b0a8aba93e req-7285cc5a-7307-42f5-ade3-44a247ce4ced service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:20:59.859913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-6994dd91-7f54-41e3-b793-f8b0a8aba93e req-7285cc5a-7307-42f5-ade3-44a247ce4ced service nova] Creating event network-vif-plugged:44c57577-b7f4-4772-ade3-5e9b2dded200 for instance 6a2ba100-192e-4c39-a43a-93be37df4e63 on hv-cinder-84713 Jun 24 10:20:59.868883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-6994dd91-7f54-41e3-b793-f8b0a8aba93e req-7285cc5a-7307-42f5-ade3-44a247ce4ced service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049151 Jun 24 10:20:59.870518 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 280/555] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:20:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:21:00.111513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:00.112155 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:00.119177 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:00.119851 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:00.120808 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:00.121402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:00.320601 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:00.330645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:00.333345 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:00.334682 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-aca63457-62cd-4dd1-9873-e5119923b6d1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.227916 Jun 24 10:21:00.335828 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 276/556] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:00 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:00.379736 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-b69e52d7-ccd4-4b5e-b866-98c0b536a9e6 req-8e3f1253-af7a-4bff-8174-83737101b3c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be1b257c-d6c5-4686-96f2-73dfcb9516ef", "name": "network-vif-deleted", "tag": "f5b17bbb-f70d-4036-a17a-05e70d05ead8"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:00.392043 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b69e52d7-ccd4-4b5e-b866-98c0b536a9e6 req-8e3f1253-af7a-4bff-8174-83737101b3c7 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:00.392693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b69e52d7-ccd4-4b5e-b866-98c0b536a9e6 req-8e3f1253-af7a-4bff-8174-83737101b3c7 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:00.411600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-b69e52d7-ccd4-4b5e-b866-98c0b536a9e6 req-8e3f1253-af7a-4bff-8174-83737101b3c7 service nova] Creating event network-vif-deleted:f5b17bbb-f70d-4036-a17a-05e70d05ead8 for instance be1b257c-d6c5-4686-96f2-73dfcb9516ef on hv-cinder-84713 Jun 24 10:21:00.421281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-b69e52d7-ccd4-4b5e-b866-98c0b536a9e6 req-8e3f1253-af7a-4bff-8174-83737101b3c7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046479 Jun 24 10:21:00.422652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 281/557] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:00.807792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:00.808599 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:00.820015 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:00.820015 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:00.820620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:00.821054 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:00.883829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:00.885891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:00.886475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lazy-loading 'fault' on Instance uuid be1b257c-d6c5-4686-96f2-73dfcb9516ef {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:21:00.951122 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:00.965169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7fd9c0d1-3f57-4157-aa66-957bfee4ed0d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 200 len: 1311 microversion: 2.1 time: 0.162729 Jun 24 10:21:00.976058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 277/558] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:00 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 1311 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:21:01.356517 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:01.357228 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:01.369348 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:01.369802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:01.370581 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:01.371035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:01.604585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:01.613885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:01.615681 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:01.617200 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fcd8959e-025f-4642-a8c5-24f9bbed249f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1408 microversion: 2.20 time: 0.266023 Jun 24 10:21:01.629162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 282/559] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:01 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1408 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:01.983622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:01.984529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: be1b257c-d6c5-4686-96f2-73dfcb9516ef] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:02.007618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.008301 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.009267 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.009869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.047550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] HTTP exception thrown: Instance be1b257c-d6c5-4686-96f2-73dfcb9516ef could not be found. Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Request method failure captured: Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef HTTP/1.1 Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY744HRlPwP1EIqX0GnCPfWiw1q2DHeFzAttpSa3JDrD9vQCDI08IByFUd2W_kKKI3BrhLnEkXaQWNYhq-0Kmbp8gShZJztR5orPAhaHKtC7j6GN3pxS4zg4V79aNjZwRpLSZEK-WaPohZHtTHB87W2BhfrBjbj3UUTOUqMU6S7cVLg Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:21:02.049630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_172381cd65a94b1fa2939d6af673f6ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}] Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: acbafaab99f848828c304ca5a45a55dc Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance be1b257c-d6c5-4686-96f2-73dfcb9516ef could not be found. Jun 24 10:21:02.051115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'be1b257c-d6c5-4686-96f2-73dfcb9516ef'} Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be1b257c-d6c5-4686-96f2-73dfcb9516ef could not be found. Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:21:02.051896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be1b257c-d6c5-4686-96f2-73dfcb9516ef could not be found. Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be1b257c-d6c5-4686-96f2-73dfcb9516ef could not be found. Jun 24 10:21:02.053724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:02.055878 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Returning 404 to user: Instance be1b257c-d6c5-4686-96f2-73dfcb9516ef could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:21:02.056735 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6b24a655-13bf-45a1-8af2-475da1c99e36 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef" status: 404 len: 111 microversion: 2.1 time: 0.077654 Jun 24 10:21:02.059746 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 278/560] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:01 2022] GET /compute/v2.1/servers/be1b257c-d6c5-4686-96f2-73dfcb9516ef => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:21:02.068227 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:02.070891 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:02.079988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.080759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.081845 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.082633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.128511 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:21:02.244990 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d710af55-5721-4e7f-b60c-e162876c8367 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 204 len: 0 microversion: 2.1 time: 0.181565 Jun 24 10:21:02.245830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 283/561] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:21:02 2022] DELETE /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:21:02.255089 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:02.255966 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:02.262624 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.263361 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.264309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.265213 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.469036 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:02.486518 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b3a18662-a5d1-43db-9fc6-ee2a5862c6bb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.236008 Jun 24 10:21:02.489170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 279/562] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:02 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:02.640982 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:02.641975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:02.653947 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.655352 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.656492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.657164 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.885744 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:02.903831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:02.909248 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:02.912203 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7bb6c751-0c7f-41b0-84ef-1bf165b749bc tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1601 microversion: 2.20 time: 0.278522 Jun 24 10:21:02.913736 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 284/563] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:02 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1601 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:02.936792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:02.937586 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:02.945031 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.945695 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:02.946959 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:02.947569 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:03.076546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7ab1ee6a-819c-4bbf-89b7-c3028a0fd9ab tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.144046 Jun 24 10:21:03.082860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 280/564] 10.222.0.64 () {60 vars in 1315 bytes} [Fri Jun 24 10:21:02 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-interface => generated 285 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:03.507315 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:03.508168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:03.511645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=4,nova_api:UPDATE=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:03.522837 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:03.523451 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:03.524638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:03.525617 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:04.083939 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:04.094301 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-304d829c-2647-4854-b880-ac3c83b114b0 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.591680 Jun 24 10:21:04.095718 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 285/565] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:03 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:04.584873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-68811e72-24fc-46c1-b686-7382f3a5e2ca req-b4191358-eeb0-40aa-adb9-153304cb013a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:04.597410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-68811e72-24fc-46c1-b686-7382f3a5e2ca req-b4191358-eeb0-40aa-adb9-153304cb013a service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:04.598016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-68811e72-24fc-46c1-b686-7382f3a5e2ca req-b4191358-eeb0-40aa-adb9-153304cb013a service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:04.622892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-68811e72-24fc-46c1-b686-7382f3a5e2ca req-b4191358-eeb0-40aa-adb9-153304cb013a service nova] Creating event network-changed:44c57577-b7f4-4772-ade3-5e9b2dded200 for instance 6a2ba100-192e-4c39-a43a-93be37df4e63 on hv-cinder-84713 Jun 24 10:21:04.632975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-68811e72-24fc-46c1-b686-7382f3a5e2ca req-b4191358-eeb0-40aa-adb9-153304cb013a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050250 Jun 24 10:21:04.635700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 281/566] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:05.123128 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:05.124993 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:05.144956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.148165 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.151764 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.154026 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.511703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:05.527585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-01569792-bb3d-480c-adb1-85b56c253320 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1523 microversion: 2.1 time: 0.409300 Jun 24 10:21:05.528481 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 286/567] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:05 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1523 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:05.537544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:05.540030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:05.546743 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.547489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.548492 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.549566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.599606 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-091b2ca6-bdff-440b-bc6a-7024015061e5 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065757 Jun 24 10:21:05.601491 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 282/568] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:21:05 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:21:05.718836 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:05.719346 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:05.726614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.727087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.727870 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.728303 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.775273 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:21:05.935521 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7fd66976-9b9a-4407-94c6-44808e0c1909 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 204 len: 0 microversion: 2.1 time: 0.220923 Jun 24 10:21:05.951163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:05.952113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:05.957260 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 287/569] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:21:05 2022] DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:21:05.959643 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.960201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:05.961638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:05.962435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:06.196976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:06.207706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-508802f2-4ee7-4e22-8a66-dca89d55771a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1671 microversion: 2.1 time: 0.261101 Jun 24 10:21:06.220609 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 283/570] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:05 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1671 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:06.545189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:06.545795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:06.546344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-bcddaafd-9c90-4e8f-96a7-b9b494a1d0b3 req-cda1a5a6-3038-4afe-9c52-8680cb043f64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95be179c-5caf-487f-a710-6445f6163f51", "name": "network-vif-deleted", "tag": "05874f33-e136-4a35-af2c-074f2098eaf9"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:06.552241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:06.552694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:06.553462 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:06.554136 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:06.557645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-bcddaafd-9c90-4e8f-96a7-b9b494a1d0b3 req-cda1a5a6-3038-4afe-9c52-8680cb043f64 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:06.558530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-bcddaafd-9c90-4e8f-96a7-b9b494a1d0b3 req-cda1a5a6-3038-4afe-9c52-8680cb043f64 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:06.575059 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-bcddaafd-9c90-4e8f-96a7-b9b494a1d0b3 req-cda1a5a6-3038-4afe-9c52-8680cb043f64 service nova] Creating event network-vif-deleted:05874f33-e136-4a35-af2c-074f2098eaf9 for instance 95be179c-5caf-487f-a710-6445f6163f51 on hv-cinder-84713 Jun 24 10:21:06.581681 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-bcddaafd-9c90-4e8f-96a7-b9b494a1d0b3 req-cda1a5a6-3038-4afe-9c52-8680cb043f64 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039898 Jun 24 10:21:06.582894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 288/571] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:06.628712 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:06.636515 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e8276a24-a969-4a8e-9234-ad0f2c3b6227 tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1481 microversion: 2.1 time: 0.095137 Jun 24 10:21:06.637193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 284/572] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:06 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1481 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:07.228359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:07.231017 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:07.237657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:07.238289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:07.239103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:07.241108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:07.424737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:07.451088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-22844e84-de1d-4d1c-8789-35df4374cda8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1671 microversion: 2.1 time: 0.215787 Jun 24 10:21:07.451740 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 289/573] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:07 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1671 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:07.653559 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:07.655049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:07.663887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:07.669996 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:07.671218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:07.671693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:07.777325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'acbafaab99f848828c304ca5a45a55dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172381cd65a94b1fa2939d6af673f6ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:07.788478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0a1f3c88-e73a-4ad8-9188-7b87e1bec07d tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 200 len: 1307 microversion: 2.1 time: 0.138798 Jun 24 10:21:07.789532 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 285/574] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:07 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 1307 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:08.469355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:08.471085 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:08.478986 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:08.479445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:08.480278 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:08.480722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:08.667813 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:08.671632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:08.678912 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9cec794d-633c-4e48-a534-acb08acae861 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1671 microversion: 2.1 time: 0.213657 Jun 24 10:21:08.679725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 290/575] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:08 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1671 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:08.808818 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:08.810003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] [instance: 95be179c-5caf-487f-a710-6445f6163f51] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:08.813476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:08.821608 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:08.822080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:08.822916 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:08.823512 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:08.862181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] HTTP exception thrown: Instance 95be179c-5caf-487f-a710-6445f6163f51 could not be found. Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Request method failure captured: Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 HTTP/1.1 Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY744HRlPwP1EIqX0GnCPfWiw1q2DHeFzAttpSa3JDrD9vQCDI08IByFUd2W_kKKI3BrhLnEkXaQWNYhq-0Kmbp8gShZJztR5orPAhaHKtC7j6GN3pxS4zg4V79aNjZwRpLSZEK-WaPohZHtTHB87W2BhfrBjbj3UUTOUqMU6S7cVLg Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:21:08.863897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_172381cd65a94b1fa2939d6af673f6ba", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/172381cd65a94b1fa2939d6af673f6ba"}]}] Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 172381cd65a94b1fa2939d6af673f6ba Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-201478222 Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: acbafaab99f848828c304ca5a45a55dc Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-ServerRescueNegativeTestJSON-201478222-project Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 95be179c-5caf-487f-a710-6445f6163f51 could not be found. Jun 24 10:21:08.865484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '95be179c-5caf-487f-a710-6445f6163f51'} Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95be179c-5caf-487f-a710-6445f6163f51 could not be found. Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:21:08.866304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95be179c-5caf-487f-a710-6445f6163f51 could not be found. Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95be179c-5caf-487f-a710-6445f6163f51 could not be found. Jun 24 10:21:08.867740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:21:08.869038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] Returning 404 to user: Instance 95be179c-5caf-487f-a710-6445f6163f51 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:21:08.869038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-95f7f996-3a98-4e7c-9170-a6d61b322ddb tempest-ServerRescueNegativeTestJSON-201478222 tempest-ServerRescueNegativeTestJSON-201478222-project] 10.222.0.64 "GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51" status: 404 len: 111 microversion: 2.1 time: 0.063740 Jun 24 10:21:08.869038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 286/576] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:08 2022] GET /compute/v2.1/servers/95be179c-5caf-487f-a710-6445f6163f51 => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:21:09.235637 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-54bdb514-af36-4413-947d-cee9470f790b req-de79faec-2e84-4183-8c39-8b8914f8db88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1", "name": "network-vif-deleted", "tag": "c453626e-6db1-429e-a1a1-df11a4d87ee5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:09.297465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-54bdb514-af36-4413-947d-cee9470f790b req-de79faec-2e84-4183-8c39-8b8914f8db88 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:09.297925 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-54bdb514-af36-4413-947d-cee9470f790b req-de79faec-2e84-4183-8c39-8b8914f8db88 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:09.345658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-54bdb514-af36-4413-947d-cee9470f790b req-de79faec-2e84-4183-8c39-8b8914f8db88 service nova] Creating event network-vif-deleted:c453626e-6db1-429e-a1a1-df11a4d87ee5 for instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 on hv-cinder-84713 Jun 24 10:21:09.379376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-54bdb514-af36-4413-947d-cee9470f790b req-de79faec-2e84-4183-8c39-8b8914f8db88 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.149578 Jun 24 10:21:09.390404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 291/577] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:09.697926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:09.698931 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:09.730609 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:09.740388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:09.744695 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:09.745463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:09.834989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:09.838922 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:09.839606 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lazy-loading 'fault' on Instance uuid e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:21:09.925618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:09.939372 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6038b90f-0a9d-4fd9-908b-43ec838b278d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 200 len: 1325 microversion: 2.1 time: 0.244644 Jun 24 10:21:09.950653 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 287/578] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:09 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 1325 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:10.958442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:10.959347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:10.992764 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:10.993240 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:10.994057 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:10.994495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:11.065283 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] HTTP exception thrown: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Request method failure captured: Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 HTTP/1.1 Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY71bBmzQ9RuB5L45nlXl3-E435ze0k8C5PRUKntJrVnTqPTLbGlQKGZFX1iQKD97TZ_KLIcEcVO87ZGJ2txUCwIr-3Db3GDS2Ps-FpSRpm9OwLnXZOgxLbJYW5XDSubCTb8fVV1dGnGEZjyxp7qdNhgKMr8WrId7FXPAHFUk77T3PA Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:21:11.067025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a33a4f77f0ae4dc09d4f8c29babf3b03", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}] Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 6ca14b36fc754fe9b24abdfecf0f64c0 Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:21:11.068614 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1'} Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:21:11.069489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:21:11.070894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:21:11.072199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Returning 404 to user: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:21:11.072199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c3a1aadd-c2e2-4616-b38a-5fe1ddbc0ab2 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 404 len: 111 microversion: 2.1 time: 0.114646 Jun 24 10:21:11.072199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 292/579] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:10 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 111 bytes in 116 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:21:11.079030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a9ab9ea5-ac8e-4aba-8b30-162497072cad tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '.version_select at 0x7f3774ae30d0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:11.134392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a9ab9ea5-ac8e-4aba-8b30-162497072cad tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-628857789" status: 202 len: 0 microversion: 2.1 time: 0.059267 Jun 24 10:21:11.137125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 288/580] 10.222.0.64 () {58 vars in 1217 bytes} [Fri Jun 24 10:21:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-628857789 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:21:12.529366 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-961bc094-54ca-407c-b5fd-0a3967bcf61b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: .version_select at 0x7f3774ac7790>, body: {"keypair": {"name": "tempest-keypair-1530138725", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI5K4TE1cocDB0U8UTlRUPPg77Q+X/xvGBnMXUJZftCottUuJ2UH2klKXT/fQPlkM6ciybKvRt1l/hvaY1ITtI+L9+bu9Ctb0AKD2qe3APNP9LqtD05c7YSjngfYbnnktA=="}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:12.557338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-961bc094-54ca-407c-b5fd-0a3967bcf61b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:21:12.562264 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-961bc094-54ca-407c-b5fd-0a3967bcf61b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for user 6ca14b36fc754fe9b24abdfecf0f64c0 and project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:21:12.609508 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-961bc094-54ca-407c-b5fd-0a3967bcf61b tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.083417 Jun 24 10:21:12.610751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 293/581] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:21:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:21:14.866184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1486404416", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d5489725-cb1e-4af4-bc56-f04397965dc8"}], "security_groups": [{"name": "tempest-securitygroup--815699330"}], "key_name": "tempest-keypair-1530138725", "user_data": "}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:15.148282 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] validate_networks() for [('d5489725-cb1e-4af4-bc56-f04397965dc8', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:21:15.702196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:21:15.702623 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:21:15.703614 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:21:15.704224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:21:15.704925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:21:15.722805 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:15.723566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:15.724574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:15.725173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:15.745671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:21:15.750686 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Getting quotas for user 6ca14b36fc754fe9b24abdfecf0f64c0 and project a33a4f77f0ae4dc09d4f8c29babf3b03. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:21:15.768426 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:21:15.772702 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:21:15.857189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-75d8a6f5-3dff-421c-a2e8-dcce4f48277c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.996263 Jun 24 10:21:15.858782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 289/582] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:21:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 999 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 24 10:21:15.869438 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-77ea2dbc-9d2e-4c23-a8ba-f4dc64134c74 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:15.870056 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-77ea2dbc-9d2e-4c23-a8ba-f4dc64134c74 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:15.981905 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-77ea2dbc-9d2e-4c23-a8ba-f4dc64134c74 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:15.989619 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-77ea2dbc-9d2e-4c23-a8ba-f4dc64134c74 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1238 microversion: 2.1 time: 0.124754 Jun 24 10:21:15.991871 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 294/583] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:15 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1238 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:17.017652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:17.021592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:17.047921 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:17.049240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:17.051972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:17.052435 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:17.213748 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:17.225535 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0c58469b-671d-4a89-9f7b-0e8923cdf120 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1298 microversion: 2.1 time: 0.220304 Jun 24 10:21:17.231581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 290/584] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:17 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1298 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:18.247565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:18.248131 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:18.262540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:18.265809 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:18.267197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:18.267703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:18.464462 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:18.474535 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a7c09ce1-501b-47e1-9279-8e02a4120866 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.232471 Jun 24 10:21:18.479533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 295/585] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:18 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:18.776860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bd067ada-4e86-43c2-a998-fb323cb55956 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Action: 'create', calling method: .version_select at 0x7f37749ebdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-170699949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRy8P4UNpgxgDG4468PflqLETPP26RR3jSeSKb7GGLTWvU2UshPcBciTSZ/JJqOnFIw2EWU3dlPDP80+Xin55B1k4pVpQWKsHKvOaUW3wn/AAO4WLaTAnp6oal8d2xHYw=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:18.797915 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-bd067ada-4e86-43c2-a998-fb323cb55956 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Getting quotas for project 34f04f4ab2294464bdc83acecb4d9a79. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:21:18.802912 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-bd067ada-4e86-43c2-a998-fb323cb55956 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Getting quotas for user ef90ff4734c249ab965ebf920270b20b and project 34f04f4ab2294464bdc83acecb4d9a79. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:21:18.831728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bd067ada-4e86-43c2-a998-fb323cb55956 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.061471 Jun 24 10:21:18.847423 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 291/586] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:21:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:18.979554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-544432367", "imageRef": "2eb7ddb9-bf83-4154-9fd9-ea93f0c207e6", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-170699949", "networks": [{"uuid": "c3dbd8da-335a-433c-9ef1-e6bc6e20a951"}]}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:19.032601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] validate_networks() for [('c3dbd8da-335a-433c-9ef1-e6bc6e20a951', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:21:19.207929 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-c51c183e-2b0a-4590-9f7a-dd9d9cc690f6 req-204e3f08-c98e-4c1b-9875-e29bad6617e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aceb1aea-5d5b-4319-8492-5f09e252f229", "tag": "df594e9b-d73f-4c5c-acde-1ee318cc8d21"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:19.230278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-c51c183e-2b0a-4590-9f7a-dd9d9cc690f6 req-204e3f08-c98e-4c1b-9875-e29bad6617e0 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:19.230876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-c51c183e-2b0a-4590-9f7a-dd9d9cc690f6 req-204e3f08-c98e-4c1b-9875-e29bad6617e0 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:19.246025 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-c51c183e-2b0a-4590-9f7a-dd9d9cc690f6 req-204e3f08-c98e-4c1b-9875-e29bad6617e0 service nova] Creating event network-changed:df594e9b-d73f-4c5c-acde-1ee318cc8d21 for instance aceb1aea-5d5b-4319-8492-5f09e252f229 on hv-cinder-84713 Jun 24 10:21:19.252874 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-c51c183e-2b0a-4590-9f7a-dd9d9cc690f6 req-204e3f08-c98e-4c1b-9875-e29bad6617e0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048162 Jun 24 10:21:19.253921 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 292/587] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:21:19.492931 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:19.493646 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:19.512511 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:19.513016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:19.514449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:19.515192 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:19.547733 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:21:19.548241 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:21:19.548904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:21:19.549490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:21:19.549961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:21:19.559442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:19.560186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:19.560977 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:19.561668 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:19.578917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Getting quotas for project 34f04f4ab2294464bdc83acecb4d9a79. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:21:19.585583 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Getting quotas for user ef90ff4734c249ab965ebf920270b20b and project 34f04f4ab2294464bdc83acecb4d9a79. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:21:19.597820 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:21:19.600171 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='2eb7ddb9-bf83-4154-9fd9-ea93f0c207e6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:21:19.658601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f70a5ce8-a6ab-437c-afac-3160bbac881f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.682918 Jun 24 10:21:19.663338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 296/588] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:21:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 688 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:21:19.670404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-01c0bc54-f201-4207-9556-2bfba8dd9e8b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:19.671042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-01c0bc54-f201-4207-9556-2bfba8dd9e8b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:19.679150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:19.700428 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-360b20be-da03-4e11-84da-a951e799c48d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.211463 Jun 24 10:21:19.712794 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 293/589] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:19 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:19.754123 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-01c0bc54-f201-4207-9556-2bfba8dd9e8b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:19.763370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-01c0bc54-f201-4207-9556-2bfba8dd9e8b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1257 microversion: 2.1 time: 0.096797 Jun 24 10:21:19.764133 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 297/590] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:19 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1257 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:20.720652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:20.721442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:20.728145 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:20.728607 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:20.729408 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:20.732523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:20.783964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:20.785191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:20.797867 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:20.798651 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:20.799873 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:20.800566 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:20.880536 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:20.894161 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-eac3466e-7b43-43cf-9e92-df8cb3c0e485 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1309 microversion: 2.1 time: 0.114741 Jun 24 10:21:20.902896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 298/591] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:20 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1309 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:20.913115 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:20.922196 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-11f6be3b-7a4e-4baa-9220-4ce3d596f51d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.204574 Jun 24 10:21:20.925975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 294/592] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:20 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:21.912091 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:21.915455 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:21.957133 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:21.957968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:21.959853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:21.960539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:22.307021 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:22.314751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-abc06c78-44e6-41bd-b39b-e6bb09502630 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.406693 Jun 24 10:21:22.317246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 299/593] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:21 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:22.477024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:22.478837 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:22.489996 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:22.492338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:22.495013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:22.496217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:22.543635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=100 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:22.932615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:22.943069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-cd3c296c-f92f-4d8f-aab9-b8fbded38e9c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 1.008070 Jun 24 10:21:22.944340 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 295/594] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:21 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:21:23.334339 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:23.335569 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:23.357680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-ef86e1d0-98b3-4c85-83f5-55609e991571 req-0aca5c6c-4775-4b38-8331-3c849ed5a018 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:23.365146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:23.365593 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:23.366457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:23.367065 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:23.377690 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-ef86e1d0-98b3-4c85-83f5-55609e991571 req-0aca5c6c-4775-4b38-8331-3c849ed5a018 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:23.378146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-ef86e1d0-98b3-4c85-83f5-55609e991571 req-0aca5c6c-4775-4b38-8331-3c849ed5a018 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:23.409944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-ef86e1d0-98b3-4c85-83f5-55609e991571 req-0aca5c6c-4775-4b38-8331-3c849ed5a018 service nova] Creating event network-changed:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:21:23.434625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-ef86e1d0-98b3-4c85-83f5-55609e991571 req-0aca5c6c-4775-4b38-8331-3c849ed5a018 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082232 Jun 24 10:21:23.435671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 296/595] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Jun 24 10:21:23.592329 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:23.606632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f332872d-8b3e-4071-8f5f-33ca0e5e4438 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.276469 Jun 24 10:21:23.617966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 300/596] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:23 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:23.680786 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-9d9d5914-7fa5-4d17-bb78-4f82b2e67549 req-fd83b192-cc26-4e6b-b58b-4a9bc6d07acc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aceb1aea-5d5b-4319-8492-5f09e252f229", "name": "network-vif-plugged", "status": "completed", "tag": "df594e9b-d73f-4c5c-acde-1ee318cc8d21"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:23.698960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-9d9d5914-7fa5-4d17-bb78-4f82b2e67549 req-fd83b192-cc26-4e6b-b58b-4a9bc6d07acc service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:23.699762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-9d9d5914-7fa5-4d17-bb78-4f82b2e67549 req-fd83b192-cc26-4e6b-b58b-4a9bc6d07acc service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:23.723078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-9d9d5914-7fa5-4d17-bb78-4f82b2e67549 req-fd83b192-cc26-4e6b-b58b-4a9bc6d07acc service nova] Creating event network-vif-plugged:df594e9b-d73f-4c5c-acde-1ee318cc8d21 for instance aceb1aea-5d5b-4319-8492-5f09e252f229 on hv-cinder-84713 Jun 24 10:21:23.729139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-9d9d5914-7fa5-4d17-bb78-4f82b2e67549 req-fd83b192-cc26-4e6b-b58b-4a9bc6d07acc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065665 Jun 24 10:21:23.730092 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 297/597] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:23.959810 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:23.960737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:23.978262 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:23.979009 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:23.979973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:23.980564 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:24.171356 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:24.182985 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-88bf3783-d2c3-4ccc-8c2a-60b3109bce6d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.226867 Jun 24 10:21:24.196558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 301/598] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:23 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:24.627476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:24.628559 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:24.641304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:24.642246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:24.643640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:24.643640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:24.798457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:24.806985 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3124c575-bfc5-4d6f-b4ff-39713bfc4797 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.184876 Jun 24 10:21:24.807573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 298/599] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:24 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:25.200928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:25.201573 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:25.209041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:25.209495 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:25.210619 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:25.211477 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:25.372766 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:25.390350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2a8a720c-c6ac-4f64-bd8f-44fb89a3dc43 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.193281 Jun 24 10:21:25.390965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 302/600] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:25 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:25.824974 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:25.826448 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:25.830080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:25.834021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:25.834476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:25.835357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:25.835982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:26.045533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:26.054583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0039c6c8-d6b6-4831-96f8-5599ccdd90c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.233482 Jun 24 10:21:26.055706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 299/601] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:25 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:21:26.409028 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:26.409730 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:26.416843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:26.417362 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:26.418405 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:26.419166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:26.561618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:26.569318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-97f45468-9e2d-4ea8-a1f7-47b17442a221 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.165348 Jun 24 10:21:26.570223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 303/602] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:26 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:27.072601 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:27.073280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:27.080246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:27.080639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:27.081412 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:27.081846 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:27.234935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:27.244806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-45d08045-819c-43ff-856b-a77de7cac5f0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.176064 Jun 24 10:21:27.247944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 300/603] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:27 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:27.586487 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:27.587138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:27.594564 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:27.598152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:27.599053 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:27.599498 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:27.744762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:27.752611 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-edbe441c-2f0a-45a4-bb5f-433453eaca7d tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.169976 Jun 24 10:21:27.753533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 304/604] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:27 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:28.265135 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:28.265790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:28.272876 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:28.273330 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:28.274095 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:28.274494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:28.451100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:28.458419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ee552e01-017e-4d9a-98a5-b71679f35d3a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.197218 Jun 24 10:21:28.459121 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 301/605] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:28 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:28.769761 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:28.770392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:28.777117 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:28.777896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:28.779054 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:28.779704 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:28.983691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:28.993170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3a7f1368-5caa-481c-9870-cf21c100af98 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.227419 Jun 24 10:21:28.993754 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 305/606] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:28 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:29.477707 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:29.479080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:29.485478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=10 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:29.492737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:29.493203 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:29.493991 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:29.494430 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:29.690243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:29.698903 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2642b8f6-74a1-4ddd-b364-fb32bf90b6db tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.225778 Jun 24 10:21:29.699808 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 302/607] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:29 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:30.012063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:30.012725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:30.015206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:30.016003 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=14 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:30.023621 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:30.024122 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:30.024981 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:30.025448 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:30.168757 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:30.178035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-adea4b8a-9d02-4f5b-a43f-9ff4b74f91d8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.170788 Jun 24 10:21:30.179150 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 306/608] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:30 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:21:30.717730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:30.718361 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:30.725699 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:30.726151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:30.726961 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:30.727405 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:30.866043 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:30.873787 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-663866e4-e95f-44c3-bf4d-dd05c6806a90 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.160429 Jun 24 10:21:30.874371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 303/609] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:30 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:31.195660 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:31.196274 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:31.202941 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:31.203398 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:31.204172 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:31.204707 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:31.586938 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:31.594784 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ac217607-7059-48a1-973b-31de4630af9e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1363 microversion: 2.1 time: 0.403090 Jun 24 10:21:31.595419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 307/610] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:31 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1363 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:31.893277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:31.893886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:31.900760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:31.901206 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:31.901964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:31.902396 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:32.034617 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:32.042215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-def91530-df60-4568-ad35-5c9910bf2c9b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.154461 Jun 24 10:21:32.042787 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 304/611] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:31 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:32.618839 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:32.619468 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:32.628197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:32.628862 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:32.629880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:32.630445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:32.778460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:32.786440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b52374eb-ba9b-4b59-948f-e037db0dbae0 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1549 microversion: 2.1 time: 0.173078 Jun 24 10:21:32.787238 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 308/612] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:32 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:32.803101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:32.803622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:32.809657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:32.810092 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:32.810960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:32.811390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:32.890441 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4fd7dd0f-773a-49d0-8ef1-35887b9dc6b9 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091214 Jun 24 10:21:32.891132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 305/613] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:21:32 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:21:33.060077 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:33.060957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:33.067965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:33.068258 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:33.069076 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:33.069505 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:33.383796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:33.393108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f572ac56-cb70-47d2-a04f-eb67241c7dc5 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.336807 Jun 24 10:21:33.403250 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 309/614] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:33 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:34.071446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-7cf4af03-2bd0-4fc5-beae-8eedc0e42429 req-b60c4311-f990-44b9-86cc-a16e22b498ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aceb1aea-5d5b-4319-8492-5f09e252f229", "tag": "df594e9b-d73f-4c5c-acde-1ee318cc8d21"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:34.085781 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-7cf4af03-2bd0-4fc5-beae-8eedc0e42429 req-b60c4311-f990-44b9-86cc-a16e22b498ba service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:34.086471 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-7cf4af03-2bd0-4fc5-beae-8eedc0e42429 req-b60c4311-f990-44b9-86cc-a16e22b498ba service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:34.101638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-7cf4af03-2bd0-4fc5-beae-8eedc0e42429 req-b60c4311-f990-44b9-86cc-a16e22b498ba service nova] Creating event network-changed:df594e9b-d73f-4c5c-acde-1ee318cc8d21 for instance aceb1aea-5d5b-4319-8492-5f09e252f229 on hv-cinder-84713 Jun 24 10:21:34.107048 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-7cf4af03-2bd0-4fc5-beae-8eedc0e42429 req-b60c4311-f990-44b9-86cc-a16e22b498ba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039764 Jun 24 10:21:34.107987 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 306/615] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:34.411371 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:34.412176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:34.422130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:34.424968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:34.425761 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:34.427822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:34.428498 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:34.607309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:34.615817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ef799945-76a9-4d2b-9273-062d0746e406 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.209240 Jun 24 10:21:34.617510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 310/616] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:34 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:35.635923 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:35.636619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:35.640793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-ce270dac-4927-4e18-b1e3-44eab765156a req-7c7050c6-11ba-4dad-b32c-4eb29e44d6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "name": "network-vif-plugged", "status": "completed", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:35.643827 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:35.645629 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:35.646414 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:35.647027 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:35.655020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-ce270dac-4927-4e18-b1e3-44eab765156a req-7c7050c6-11ba-4dad-b32c-4eb29e44d6f5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:35.655468 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-ce270dac-4927-4e18-b1e3-44eab765156a req-7c7050c6-11ba-4dad-b32c-4eb29e44d6f5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:35.671275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-ce270dac-4927-4e18-b1e3-44eab765156a req-7c7050c6-11ba-4dad-b32c-4eb29e44d6f5 service nova] Creating event network-vif-plugged:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:21:35.683941 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-ce270dac-4927-4e18-b1e3-44eab765156a req-7c7050c6-11ba-4dad-b32c-4eb29e44d6f5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046965 Jun 24 10:21:35.685145 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 311/617] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:35.826057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:35.834344 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a956b352-ad62-4cc0-a29a-596ec9302262 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.203960 Jun 24 10:21:35.836172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 307/618] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:35 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:36.853805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:36.854500 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:36.861521 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:36.861954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:36.864791 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:36.865650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:37.003938 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:37.012820 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1964e0da-c556-4eec-84a3-71f71e96d2da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1357 microversion: 2.1 time: 0.163191 Jun 24 10:21:37.013391 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 312/619] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:36 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1357 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:38.030214 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:38.030973 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:38.037569 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.038023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.038819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.039259 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.183323 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:38.190995 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ccb6fd11-e060-49bf-9140-4e2c19b91ffb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1547 microversion: 2.1 time: 0.165056 Jun 24 10:21:38.191689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 308/620] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:38 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1547 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:38.207586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:38.208278 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:38.215259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.215703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.216492 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.216922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.221037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=100 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:38.400964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:38.409151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b1d6974f-cd1f-4c32-a41c-fd90d41889da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1547 microversion: 2.1 time: 0.205568 Jun 24 10:21:38.410062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 313/621] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:38 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1547 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:38.425271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:38.429261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:38.430158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Searching by: {'deleted': False, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79'} {{(pid=117855) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 24 10:21:38.437442 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.437978 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.438811 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.439248 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.533499 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.multi_cell_list [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117855) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 24 10:21:38.628086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c9fcc78c-c02c-49bd-b127-62e5f3317de7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.206671 Jun 24 10:21:38.628685 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 309/622] 10.222.0.64 () {58 vars in 1124 bytes} [Fri Jun 24 10:21:38 2022] GET /compute/v2.1/servers => generated 342 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:38.640754 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:38.641367 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:38.647839 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.648306 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.649054 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:38.649482 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:38.788022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:38.795534 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2ebd507e-289e-4cc3-8d1f-1030230b1b35 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1547 microversion: 2.1 time: 0.158591 Jun 24 10:21:38.796081 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 314/623] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:38 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:40.360633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "349d72c8-fa1b-423a-81cf-3c6b7558ae55"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:40.364826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:40.364826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=73,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:40.370343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:40.370820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:40.371590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:40.372021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:40.625516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e4fe0802-f812-48ed-aabd-5660f033fe57 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268907 Jun 24 10:21:40.626178 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 310/624] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:21:40 2022] POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments => generated 194 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:48.216376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:48.217146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:48.224060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:48.224581 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:48.225410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:48.225910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:48.376806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:48.385065 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b6255ed8-bd19-4d87-9e59-30aa90aa433f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1593 microversion: 2.1 time: 0.173031 Jun 24 10:21:48.385875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 315/625] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:48 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1593 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:48.891758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:49.162135 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:49.162736 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:49.169748 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:49.170230 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:49.171138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:49.171575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:49.200056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-44774000-2bd3-4158-8e50-1bf808b01216 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/ips" status: 200 len: 153 microversion: 2.20 time: 0.309734 Jun 24 10:21:49.200949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 311/626] 10.222.0.64 () {60 vars in 1288 bytes} [Fri Jun 24 10:21:48 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/ips => generated 153 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:21:50.778739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-0e4a0d21-5a8e-4047-9429-5646bc26235c req-46f638b4-100b-4057-ac9d-98ca32c9b2d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:50.794373 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-0e4a0d21-5a8e-4047-9429-5646bc26235c req-46f638b4-100b-4057-ac9d-98ca32c9b2d6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:50.794876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-0e4a0d21-5a8e-4047-9429-5646bc26235c req-46f638b4-100b-4057-ac9d-98ca32c9b2d6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:50.817423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-0e4a0d21-5a8e-4047-9429-5646bc26235c req-46f638b4-100b-4057-ac9d-98ca32c9b2d6 service nova] Creating event network-changed:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:21:50.825380 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-0e4a0d21-5a8e-4047-9429-5646bc26235c req-46f638b4-100b-4057-ac9d-98ca32c9b2d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.248343 Jun 24 10:21:50.826793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 316/627] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:51.077759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:51.078984 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:51.087347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:51.088338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:51.089296 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:51.089732 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:51.117394 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lazy-loading 'flavor' on Instance uuid 6a2ba100-192e-4c39-a43a-93be37df4e63 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:21:51.142880 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:21:51.465430 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2043b6d4-9f35-49d1-9255-da0d8ced22e2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/action" status: 202 len: 0 microversion: 2.20 time: 0.391568 Jun 24 10:21:51.467172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 312/628] 10.222.0.64 () {62 vars in 1318 bytes} [Fri Jun 24 10:21:51 2022] POST /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:21:51.477832 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:51.479880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:51.489157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:51.489936 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:51.491276 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:51.492037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:51.693689 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:51.703123 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:51.704904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:51.706093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-007be78c-2b25-46a4-b96f-e3b44bb976e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.235004 Jun 24 10:21:51.706652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 317/629] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:51 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:52.064663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1204944247"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:52.065286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:52.072142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.072871 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:52.073643 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.074255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:52.237737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.network.security_group_api [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Adding security group 5f9df3e4-d2c7-4c7e-99dc-2ca13630ed97 to port 9b477745-37af-4221-acf2-e595e7642fe8 Jun 24 10:21:52.654374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e6b225fc-75c1-4f69-a9c1-f85721fef696 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/action" status: 202 len: 0 microversion: 2.1 time: 0.595062 Jun 24 10:21:52.655232 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 313/630] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:21:52 2022] POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:21:52.674042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:52.676154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:52.690774 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.695740 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:52.696475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.696926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:52.842583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-4ec2ff58-951a-4ba6-8fca-8b99df2f029c req-55e333b4-cf84-4f26-9705-b9a6610a61d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:21:52.856240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-4ec2ff58-951a-4ba6-8fca-8b99df2f029c req-55e333b4-cf84-4f26-9705-b9a6610a61d5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.856686 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-4ec2ff58-951a-4ba6-8fca-8b99df2f029c req-55e333b4-cf84-4f26-9705-b9a6610a61d5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:52.877572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:52.881740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-4ec2ff58-951a-4ba6-8fca-8b99df2f029c req-55e333b4-cf84-4f26-9705-b9a6610a61d5 service nova] Creating event network-changed:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:21:52.887644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-4ec2ff58-951a-4ba6-8fca-8b99df2f029c req-55e333b4-cf84-4f26-9705-b9a6610a61d5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224862 Jun 24 10:21:52.888249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 314/631] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:21:52.888600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8bd5e52b-231e-4eb0-835d-1dd4433171b3 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1758 microversion: 2.1 time: 0.228822 Jun 24 10:21:52.892583 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 318/632] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:21:52 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1758 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:21:52.897124 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:52.897837 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:52.920703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.922299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:52.925145 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:52.925645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:53.118514 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:53.128331 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:53.130861 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:53.132393 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b0eab0af-6c07-4ad0-bfee-d5dcbf8cd3c5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.242901 Jun 24 10:21:53.144771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 315/633] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:52 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:54.151439 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:54.152138 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:54.159227 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:54.159669 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:54.160635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:54.161057 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:54.527323 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:54.536665 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:54.538430 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:54.539795 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5f800ebe-2e5e-4b96-a155-84668f8ab442 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.392411 Jun 24 10:21:54.540530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 319/634] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:54 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:55.558359 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:55.559021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:55.566464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:55.567057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:55.567867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:55.568306 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:55.724024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:55.732676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:55.734190 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:55.735413 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b1f6b0c7-9cf8-4e31-ab80-550e913cda9c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.181078 Jun 24 10:21:55.735964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 316/635] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:55 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:56.753609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:56.754166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:56.760736 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:56.761366 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:56.762127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:56.762558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:56.902354 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:56.910467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:56.912093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:56.913261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-13338517-eaa1-4175-9a71-2ecc522d5aef tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.163644 Jun 24 10:21:56.913822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 320/636] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:56 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:57.931710 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:57.932319 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:57.939135 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:57.939588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:57.940349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:57.940787 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:58.073652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:58.081892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:58.083486 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:58.085360 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3bcc1e77-f3b1-4637-96a6-50773906ed1c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.157022 Jun 24 10:21:58.086005 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 317/637] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:57 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:21:59.108001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:21:59.108926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:21:59.120432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:59.121152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:59.122297 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:21:59.123013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:21:59.264030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:59.272721 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:59.274487 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:21:59.275770 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b809678d-6172-4f8e-98f8-8e0f40a61843 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.173869 Jun 24 10:21:59.276409 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 321/638] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:21:59 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:00.297792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:00.298852 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:00.307578 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:00.308028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:00.308789 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:00.309225 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:00.441948 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:00.453202 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:00.455418 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:00.457190 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0cfbe303-bbb5-468e-ab62-521b43f225a8 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.165572 Jun 24 10:22:00.457941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 318/639] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:00 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:01.476401 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:01.476998 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:01.483441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:01.483886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:01.484647 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:01.485073 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:01.648170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:01.659770 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:01.661344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:01.662642 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b58dbd4f-c1a4-4e7c-a4c5-df381dab7f9b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.190390 Jun 24 10:22:01.675394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 322/640] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:01 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:02.683024 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:02.683692 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:02.690758 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:02.691372 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:02.692207 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:02.692762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:02.839370 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:02.847333 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:02.849223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:02.850654 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-659a25bc-970e-47dc-99c3-72f424687d8f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1747 microversion: 2.20 time: 0.171608 Jun 24 10:22:02.851524 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 319/641] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:02 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1747 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:03.870628 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:03.871239 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:03.878000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:03.878419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:03.879247 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:03.879672 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:04.016887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:04.026506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:04.028106 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:04.029266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d12558ed-8b4c-4503-866b-2ebbc079171d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1747 microversion: 2.20 time: 0.163512 Jun 24 10:22:04.029833 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 323/642] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:03 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1747 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:05.048926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:05.050578 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:05.059033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:05.065140 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:05.066244 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:05.066958 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:05.248374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:05.256925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:05.259431 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:05.260836 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0ad38a7f-40c5-460d-8857-5b306b49bfb6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.216028 Jun 24 10:22:05.271750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 320/643] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:05 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:05.959299 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-d25d2a75-1cac-4790-b5e3-4c4a6c4b42ce req-f3a4bc2b-c210-4405-8753-96ebe4517df5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "name": "network-vif-plugged", "status": "completed", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:05.966082 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=28 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:05.970284 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-d25d2a75-1cac-4790-b5e3-4c4a6c4b42ce req-f3a4bc2b-c210-4405-8753-96ebe4517df5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:05.970789 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-d25d2a75-1cac-4790-b5e3-4c4a6c4b42ce req-f3a4bc2b-c210-4405-8753-96ebe4517df5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:05.984253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-d25d2a75-1cac-4790-b5e3-4c4a6c4b42ce req-f3a4bc2b-c210-4405-8753-96ebe4517df5 service nova] Creating event network-vif-plugged:44c57577-b7f4-4772-ade3-5e9b2dded200 for instance 6a2ba100-192e-4c39-a43a-93be37df4e63 on hv-cinder-84713 Jun 24 10:22:05.989780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-d25d2a75-1cac-4790-b5e3-4c4a6c4b42ce req-f3a4bc2b-c210-4405-8753-96ebe4517df5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198226 Jun 24 10:22:05.990370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 324/644] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:22:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:06.279680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:06.281197 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:06.294094 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:06.294733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:06.295525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:06.295964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:06.453661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:06.462058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:06.463962 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:06.465133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d928c006-fb57-4e16-8a9e-c791d3bb614a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.189490 Jun 24 10:22:06.465690 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 321/645] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:06 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:07.485206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:07.485893 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:07.495296 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:07.495773 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:07.496736 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:07.497243 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:07.639797 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:07.648155 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:07.649645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:07.650836 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-200448a2-f410-445c-9765-12846428e6e9 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.170065 Jun 24 10:22:07.665796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 325/646] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:07 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:08.668588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:08.670064 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:08.676917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:08.677753 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:08.678633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:08.679166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:08.824905 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:08.833788 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:08.835449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:08.836778 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-49f15463-239a-41e1-a1b8-8ba67b0c9ea2 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.172150 Jun 24 10:22:08.837633 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 322/647] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:08 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:09.513583 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:09.514263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:09.522634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:09.522951 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:09.523656 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:09.524105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:09.529510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=69 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:09.552869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lazy-loading 'flavor' on Instance uuid 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:22:09.635816 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-069eb3c5-1cd7-49d7-a1d4-f193d2528815 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "POST /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d/action" status: 202 len: 0 microversion: 2.1 time: 0.127236 Jun 24 10:22:09.638743 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 326/648] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:22:09 2022] POST /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d/action => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:22:09.645241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:09.645997 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:09.655493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:09.656062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:09.656943 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:09.657425 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:09.808041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:09.819224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-05d80f67-8d15-4889-9257-fe6a0f150889 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.177837 Jun 24 10:22:09.819897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 323/649] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:09 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:09.855759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:09.856454 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:09.863248 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:09.863692 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:09.864452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:09.864879 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:10.016947 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:10.027318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:10.028825 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:10.030097 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d2ea5b7f-0649-47fc-bcb0-8c8bdea19295 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.178825 Jun 24 10:22:10.030645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 327/650] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:09 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:10.355446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:10.357065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:10.365151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:10.366191 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:10.367219 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:10.367861 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:10.393067 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8098ba57-c08b-492f-83aa-a941e5d35b12 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/ips" status: 200 len: 145 microversion: 2.1 time: 0.041431 Jun 24 10:22:10.411994 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 324/651] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:22:10 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/ips => generated 145 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:10.836616 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:10.837241 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:10.848482 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:10.849189 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:10.852168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:10.853213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:11.009972 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:11.018107 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7f4cb21e-1b99-49c0-8912-f7e573cb65d8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.185459 Jun 24 10:22:11.029844 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 328/652] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:10 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:11.049638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:11.050246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:11.052768 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=30 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:11.059980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:11.061069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:11.061852 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:11.062280 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:11.243719 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:11.252460 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:11.254251 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:11.255451 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3821b17f-2c9a-484e-b911-93e1c36f6c4c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.209777 Jun 24 10:22:11.256564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 325/653] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:11 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:22:11.814053 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "633f4597-ea27-46b9-822f-da8a0046c830"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:11.815232 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:11.826621 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:11.827431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:11.828067 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:11.828502 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:12.037877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:12.038487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:12.046589 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:12.047058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:12.047891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:12.048317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:12.186898 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-33434301-0089-4709-9b00-dff926f41b25 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376680 Jun 24 10:22:12.188452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 329/654] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:22:11 2022] POST /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:12.245864 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:12.254022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-624506a7-ea42-40b5-bfb4-5bf7a3dbdf7c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.220392 Jun 24 10:22:12.254587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 326/655] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:12 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:12.276074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:12.277024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:12.285522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:12.285963 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:12.286751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:12.287169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:12.448177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:12.456819 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:12.458445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:12.459747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-64d06491-3344-4d2e-93cb-4ad57bd43a36 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.189190 Jun 24 10:22:12.470751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 330/656] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:12 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:13.271324 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:13.272673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:13.280767 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:13.281500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:13.282299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:13.282751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:13.446367 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:13.458149 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-08b7779a-8de5-4cae-a918-8687e9e54766 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.191125 Jun 24 10:22:13.459384 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 327/657] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:13 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:13.479587 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:13.480227 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:13.486645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:13.487132 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:13.488236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:13.488679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:13.635322 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:13.643961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:13.645747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:13.647263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-248e6fa6-ef74-44bc-864b-e42e1ed12260 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1742 microversion: 2.20 time: 0.172298 Jun 24 10:22:13.648359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 331/658] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:13 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1742 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:14.476503 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:14.477284 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:14.483992 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:14.484441 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:14.485199 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:14.485625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:14.625292 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:14.633239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-33f87e86-868a-4898-aa0e-f61f7e41a59c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.161084 Jun 24 10:22:14.633815 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 328/659] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:14 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:14.665400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:14.665992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:14.672810 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:14.673257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:14.674013 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:14.674443 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:14.803802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:14.812242 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:14.813852 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:14.815140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-44acc159-2ed6-49c0-a973-47c4209e6f45 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1724 microversion: 2.20 time: 0.153621 Jun 24 10:22:14.815703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 332/660] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:14 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:15.507484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:15.508523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:15.515375 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.515830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.516685 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.517180 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.521596 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:15.596006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-17a6a495-03c0-4697-a4b2-34e5e10d715b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/action" status: 202 len: 0 microversion: 2.1 time: 0.092312 Jun 24 10:22:15.596618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 329/661] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:22:15 2022] POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:22:15.605072 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:15.605683 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:15.611874 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.612317 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.613061 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.613489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.650314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:15.651040 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:15.658357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.658357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.659170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.659597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.815571 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:15.824121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6836d92a-e2a3-41d1-b85c-c2f567b18eed tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1750 microversion: 2.1 time: 0.222867 Jun 24 10:22:15.824712 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 333/662] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:15 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1750 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:15.835169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:15.838957 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:15.839632 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:15.843624 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-efdd26ac-6ccd-4882-9535-0761edf9785a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.197824 Jun 24 10:22:15.844473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 330/663] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:15 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:15.845876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.846747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.847525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:15.847952 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:15.976924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:15.985358 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:15.986891 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:15.988052 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7fb25b1f-188b-4968-a154-a79f608622e0 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1724 microversion: 2.20 time: 0.153315 Jun 24 10:22:15.988622 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 334/664] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:15 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:16.846255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:16.847259 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:16.858443 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:16.859248 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:16.860506 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:16.861224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:16.865335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:16.866275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:16.873007 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:16.873449 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:16.874210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:16.874750 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.089094 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:17.095001 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:17.096916 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-aa90f0bb-5920-4bdc-83a2-8da264f59582 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.238544 Jun 24 10:22:17.103855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bd9f4d55-41d5-4f2b-90d3-3ed6d3f061c2 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1750 microversion: 2.1 time: 0.264058 Jun 24 10:22:17.104685 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 331/665] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:16 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1750 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:17.106817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 335/666] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:16 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:17.109538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:17.110130 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:17.117365 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.118029 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.119421 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.119866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.253924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:17.264042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:17.265536 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:17.266720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6fdf319f-0631-49d2-9083-acafebe65783 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1667 microversion: 2.20 time: 0.160817 Jun 24 10:22:17.267291 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 332/667] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:17 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1667 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:17.284720 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "792b1d74-012c-4118-87a5-848d8a9b101d"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:17.285843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:17.292402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.292850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.293643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.294055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.593333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:17.601777 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fb06a584-61a4-4585-bbb7-6ff4448ea45b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.321353 Jun 24 10:22:17.602421 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 336/668] 10.222.0.64 () {62 vars in 1363 bytes} [Fri Jun 24 10:22:17 2022] POST /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-volume_attachments => generated 188 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 24 10:22:17.736605 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:17.737071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:17.744576 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.745012 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.745772 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.746198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.806854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-2c588345-ee84-4447-86d1-3bad3ee8e6ed req-dd27a367-fb01-4ed8-a14d-698539cbacdd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "name": "network-vif-unplugged", "status": "completed", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:17.817194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-2c588345-ee84-4447-86d1-3bad3ee8e6ed req-dd27a367-fb01-4ed8-a14d-698539cbacdd service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:17.817801 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-2c588345-ee84-4447-86d1-3bad3ee8e6ed req-dd27a367-fb01-4ed8-a14d-698539cbacdd service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:17.829809 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.compute.server_external_events [req-2c588345-ee84-4447-86d1-3bad3ee8e6ed req-dd27a367-fb01-4ed8-a14d-698539cbacdd service nova] Unable to find a host for instance 6a2ba100-192e-4c39-a43a-93be37df4e63. Dropping event network-vif-unplugged {{(pid=117854) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 24 10:22:17.830800 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-2c588345-ee84-4447-86d1-3bad3ee8e6ed req-dd27a367-fb01-4ed8-a14d-698539cbacdd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029792 Jun 24 10:22:17.831455 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 337/669] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:22:17 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 24 10:22:17.991919 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e29f3bca-3f8b-439b-b37c-f82ef9f255cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-volume_attachments/792b1d74-012c-4118-87a5-848d8a9b101d" status: 202 len: 0 microversion: 2.20 time: 0.259296 Jun 24 10:22:17.993982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 333/670] 10.222.0.64 () {60 vars in 1456 bytes} [Fri Jun 24 10:22:17 2022] DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-volume_attachments/792b1d74-012c-4118-87a5-848d8a9b101d => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:22:18.052703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:18.053434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:18.060709 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.061164 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.061963 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.062403 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.113438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:18.114047 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:18.121313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.121786 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.122535 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.123017 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.262525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:18.271241 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-97bde93f-1eaf-423e-9a44-f40b643c7729 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.161634 Jun 24 10:22:18.272664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 334/671] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:18 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:18.278100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:18.278793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:18.280625 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e49fd41a-976c-4848-9632-bd1b61452446 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "POST /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/action" status: 202 len: 0 microversion: 2.20 time: 0.231348 Jun 24 10:22:18.282054 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 338/672] 10.222.0.64 () {62 vars in 1318 bytes} [Fri Jun 24 10:22:18 2022] POST /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/action => generated 0 bytes in 234 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:22:18.287443 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.288171 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.289174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.289774 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.294217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:18.295181 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:18.306407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.307269 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.308509 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.309473 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.539563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:18.543589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:18.549778 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-47e77562-5517-4985-abda-0a4a946f542b tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.275770 Jun 24 10:22:18.551204 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 335/673] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:18 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:18.553603 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:18.556168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:18.557543 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-cd35515f-a6bd-4d0d-9d43-c09faa7bf04c tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1675 microversion: 2.20 time: 0.271112 Jun 24 10:22:18.558259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 339/674] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:18 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1675 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:22:18.754929 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:18.756356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:18.762666 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.763146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.763910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.764344 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.794623 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d5fe672d-f2bf-4f0f-9a69-c820f6cd136e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043684 Jun 24 10:22:18.795404 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 336/675] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:22:18 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:18.805809 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:18.806404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:18.812856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.813375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.814231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:18.814743 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:18.845977 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d82590cb-e1b7-4e1d-bd8a-ba4d13893b0a tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/633f4597-ea27-46b9-822f-da8a0046c830" status: 200 len: 194 microversion: 2.1 time: 0.044397 Jun 24 10:22:18.846674 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 340/676] 10.222.0.64 () {58 vars in 1412 bytes} [Fri Jun 24 10:22:18 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/633f4597-ea27-46b9-822f-da8a0046c830 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:19.298764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:19.299574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:19.309041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:19.309513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:19.310509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:19.311023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:19.464555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:19.472680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6c1a1248-a196-456b-a255-b226f133521a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.180146 Jun 24 10:22:19.473232 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 337/677] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:19 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:19.576284 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:19.576901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:19.578193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:19.579055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:19.583889 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:19.584360 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:19.585636 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:19.586071 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:19.586580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:19.587120 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:19.588293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:19.588920 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:19.811960 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:19.818117 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:19.820722 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:19.822211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:19.823392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1b36c3ee-1f8f-4e71-b733-131908e36e49 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.249192 Jun 24 10:22:19.823918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 338/678] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:19 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:22:19.826720 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f47b5ec7-0877-49e9-8067-97727510b02f tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.254316 Jun 24 10:22:19.827224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 341/679] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:19 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:20.195076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8de67c7a-9a53-4256-a7ba-caf5eb8bf7e9"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:20.196195 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:20.202219 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.202664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.203469 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.204168 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.471018 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-30c5fa50-67e0-49d8-be3a-608b54f27078 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "POST /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279933 Jun 24 10:22:20.472148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 339/680] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:22:20 2022] POST /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:20.493980 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:20.498616 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:20.532381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.532892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.533752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.534194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.711738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:20.722403 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d1366017-ab2a-400e-96cf-f4a4a8781d23 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.236682 Jun 24 10:22:20.734370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 342/681] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:20 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:20.843249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:20.844267 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:20.845793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:20.847635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:20.851852 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.852301 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.853072 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.853509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.854688 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.855153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:20.855901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:20.856992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:21.051682 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:21.061145 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:21.062612 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:21.063976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6c2ba2bf-b481-4e9b-8996-2bb052b1e01b tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.225346 Jun 24 10:22:21.064544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 340/682] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:20 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:21.065631 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:21.073953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ce3ebffa-9a90-4a28-9fc7-778ac37f6fff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.232848 Jun 24 10:22:21.074503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 343/683] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:20 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:21.743530 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:21.744359 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:21.752132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:21.752687 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:21.753572 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:21.754229 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:21.758266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:21.906037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:21.914603 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8c6dae41-cd50-4519-bdb4-eb1e9f7f5338 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.176031 Jun 24 10:22:21.915224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 341/684] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:21 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:22.083766 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:22.084547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:22.091971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:22.092413 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:22.093034 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:22.093226 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:22.093988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:22.094537 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:22.102181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:22.102939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:22.103918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:22.104560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:22.339210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:22.346361 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:22.347197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:22.348728 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:22.349872 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a9ce6f6f-6de6-4cb9-8ca6-d7120632ca94 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.270080 Jun 24 10:22:22.350420 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 344/685] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:22 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:22.355814 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-38c269e4-18c4-4390-8329-19c84788a38d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.268135 Jun 24 10:22:22.356298 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 342/686] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:22 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:22.932948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:22.933598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:22.940633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:22.941100 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:22.941915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:22.942587 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:23.099645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:23.107598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-54d87ea2-9d38-4aae-b1dd-7875329811d3 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.179364 Jun 24 10:22:23.117886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 345/687] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:22 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:23.368110 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:23.368752 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:23.377151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:23.377955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:23.378880 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:23.379670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:23.380787 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:23.381688 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:23.388833 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:23.389558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:23.390508 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:23.391158 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:23.594082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:23.603223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:23.605084 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:23.606503 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a2112ed8-e003-4ee3-83ec-112dd337c261 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.242884 Jun 24 10:22:23.607170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 343/688] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:23 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:23.622456 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:23.630545 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b43307f3-03a4-40b1-8ae7-af85f77c9dff tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.253579 Jun 24 10:22:23.631361 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 346/689] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:23 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:24.125669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:24.126380 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:24.134003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:24.134862 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:24.135738 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:24.136273 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:24.314374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:24.323169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b8d18c49-d97a-4e91-89eb-3eef4ab95b32 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.201594 Jun 24 10:22:24.324060 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 344/690] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:24 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:24.625595 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:24.626221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:24.633153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:24.633590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:24.634342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:24.634813 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:24.648063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:24.650043 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:24.657039 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:24.657486 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:24.658261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:24.658689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:24.883388 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:24.891763 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:24.893298 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:24.894458 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4a4a5351-2ff7-4f00-a9d4-f747837d1309 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.272930 Jun 24 10:22:24.899746 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 347/691] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:24 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:24.928423 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:24.937270 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9050f932-1455-4130-a7f1-e4f306381513 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.293316 Jun 24 10:22:24.947459 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 345/692] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:24 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:25.341721 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:25.342387 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:25.349454 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.349911 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:25.350737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.351441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:25.497361 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:25.506688 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2a576ffd-c60c-4183-9e1c-af3595b7abcc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.169453 Jun 24 10:22:25.507620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 348/693] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:25 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:25.852889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-9224487a-9047-4217-a5c7-8dd7aab4265a req-bba4a2ce-b0c3-4c54-b1a3-3d3777c617fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "name": "network-vif-unplugged", "status": "completed", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:25.864441 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-9224487a-9047-4217-a5c7-8dd7aab4265a req-bba4a2ce-b0c3-4c54-b1a3-3d3777c617fa service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.865018 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-9224487a-9047-4217-a5c7-8dd7aab4265a req-bba4a2ce-b0c3-4c54-b1a3-3d3777c617fa service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:25.888198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-9224487a-9047-4217-a5c7-8dd7aab4265a req-bba4a2ce-b0c3-4c54-b1a3-3d3777c617fa service nova] Creating event network-vif-unplugged:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:22:25.894413 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-9224487a-9047-4217-a5c7-8dd7aab4265a req-bba4a2ce-b0c3-4c54-b1a3-3d3777c617fa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.049736 Jun 24 10:22:25.895448 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 346/694] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:22:25 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:25.913068 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:25.913804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:25.920817 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.921265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:25.922064 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.922507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:25.954887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:25.955694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:25.963326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.963762 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:25.964688 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:25.965229 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:26.135976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:26.150300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:26.151954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:26.153164 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0b6ad7f1-9434-443b-a268-442094f35f4f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.244131 Jun 24 10:22:26.164165 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 349/695] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:25 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:26.198358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:26.207628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-dbd93441-b1bd-4560-b088-bfc2b84667da tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.256908 Jun 24 10:22:26.208351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 347/696] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:25 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:26.526985 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:26.527895 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:26.535553 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:26.536235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:26.537158 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:26.537668 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:26.700885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:26.709042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-11f133c8-0614-4265-b620-af80f0fb925f tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.186736 Jun 24 10:22:26.719223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 350/697] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:26 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:27.172037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:27.172627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:27.179564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:27.180042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:27.180820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:27.181250 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:27.227905 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:27.229186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:27.241858 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:27.242619 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:27.243537 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:27.243975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:27.368790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:27.377992 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:27.379718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:27.381079 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-525d62f2-0a0f-4ec6-92a1-be2fbff25a5d tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.213080 Jun 24 10:22:27.382168 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 348/698] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:27 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:27.459693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:27.468365 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0c399530-0b77-4585-a17c-5688b93124d0 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.244759 Jun 24 10:22:27.468928 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 351/699] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:27 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:27.726181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:27.726574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:27.733086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:27.733566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:27.734349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:27.734813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:27.880141 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:27.888389 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b2f64bf4-3231-4a16-abe3-37c4057ed49e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.166392 Jun 24 10:22:27.898142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 349/700] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:27 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:28.401082 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:28.401805 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:28.410035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:28.410919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:28.412025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:28.412735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:28.486760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:28.487609 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:28.495776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:28.496571 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:28.497532 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:28.498245 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:28.658242 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:28.667173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:28.668790 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:28.670050 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e72517b5-9d94-4de1-b52c-d4e066ce60e7 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.273899 Jun 24 10:22:28.671290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 352/701] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:28 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:28.718874 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:28.727589 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-516d282c-19f9-4413-aac5-5269b69d3070 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.245417 Jun 24 10:22:28.728289 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 350/702] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:28 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:28.905694 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:28.906307 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:28.912649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:28.913121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:28.914128 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:28.914558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:28.917193 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:29.079723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:29.093460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-52d7a632-b52d-43fa-a525-6b28f9d8654d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.191223 Jun 24 10:22:29.094282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 353/703] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:28 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:29.692059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:29.692815 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:29.700538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:29.700987 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:29.701759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:29.702194 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:29.745257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:29.745915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:29.754782 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:29.755332 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:29.756121 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:29.756754 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:29.895345 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:29.904892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:29.906547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:29.907751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-99477813-2f22-4bf6-bd7b-0371dac3fada tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.220487 Jun 24 10:22:29.910284 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 351/704] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:29 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:29.938479 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:29.948723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-50821dbf-111e-471a-b788-05e13a742d79 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1755 microversion: 2.1 time: 0.207443 Jun 24 10:22:29.949304 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 354/705] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:29 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1755 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:30.118141 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:30.118843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:30.125530 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:30.126023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:30.127004 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:30.127549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:30.266219 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:30.273955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-44247d1a-39e9-4b97-bac2-400ae68cbaec tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.162451 Jun 24 10:22:30.274640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 352/706] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:30 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:30.929801 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:30.930657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:30.937679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:30.938131 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:30.938941 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:30.939373 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:30.966813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:30.967419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:30.974468 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:30.974951 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:30.975722 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:30.976157 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:31.140355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:31.149197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:31.151155 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:31.152468 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c763769d-a99d-4fd5-b3a0-658f139cd4fe tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.229044 Jun 24 10:22:31.163831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 355/707] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:30 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:31.177381 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:31.186072 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8e2fab42-e572-45ee-80a1-e21a37c96ff8 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1758 microversion: 2.1 time: 0.223952 Jun 24 10:22:31.186751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 353/708] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:30 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1758 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:31.297725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:31.298537 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:31.307051 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:31.307600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:31.308524 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:31.309213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:31.461041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:31.470285 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a6965633-e1b7-4724-a707-4fdfa777d484 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.177790 Jun 24 10:22:31.470942 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 356/709] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:31 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:32.172577 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:32.173195 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:32.181051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.181501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.182304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.182782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.317625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:32.327121 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:32.328602 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:32.329748 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-eea0047e-2ab1-4d16-82ff-a64327e8d183 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.162387 Jun 24 10:22:32.330308 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 354/710] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:32 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:32.488033 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:32.488654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:32.495650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.496135 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.496969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.497502 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.636428 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:32.646091 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3e949868-cabe-49c4-b280-3fdc076d6447 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1511 microversion: 2.1 time: 0.161856 Jun 24 10:22:32.646800 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 357/711] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:32 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1511 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:32.662806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:32.663466 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:32.670669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.671139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.671931 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.672371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.913648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b95de084-ac94-4985-8c65-9b36c2b28668 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "POST /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d/action" status: 202 len: 0 microversion: 2.1 time: 0.255022 Jun 24 10:22:32.914438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 355/712] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:22:32 2022] POST /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d/action => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:22:32.922346 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:32.922984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:32.929246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.929690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:32.930461 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:32.930927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:33.137093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:33.145050 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a8614367-1a14-47f6-b157-f65c3e8a51cc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1519 microversion: 2.1 time: 0.226530 Jun 24 10:22:33.145929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 358/713] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:32 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1519 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:33.370518 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:33.370518 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:33.388346 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:33.388346 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:33.389581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:33.394925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:33.534961 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:33.542911 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:33.544521 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:33.545998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1297ac82-dd3a-4f2c-95f8-800c6f04c417 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.197773 Jun 24 10:22:33.546578 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 356/714] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:33 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:33.936769 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-e3393648-e9f6-4adb-bc95-73d52ae98302 req-c8448361-53e3-4cb8-923f-7dd549b1918c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "name": "network-vif-plugged", "status": "completed", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:33.945692 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e3393648-e9f6-4adb-bc95-73d52ae98302 req-c8448361-53e3-4cb8-923f-7dd549b1918c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:33.945981 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e3393648-e9f6-4adb-bc95-73d52ae98302 req-c8448361-53e3-4cb8-923f-7dd549b1918c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:33.958303 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-e3393648-e9f6-4adb-bc95-73d52ae98302 req-c8448361-53e3-4cb8-923f-7dd549b1918c service nova] Creating event network-vif-plugged:44c57577-b7f4-4772-ade3-5e9b2dded200 for instance 6a2ba100-192e-4c39-a43a-93be37df4e63 on hv-cinder-84713 Jun 24 10:22:33.963728 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-e3393648-e9f6-4adb-bc95-73d52ae98302 req-c8448361-53e3-4cb8-923f-7dd549b1918c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030929 Jun 24 10:22:33.964346 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 359/715] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:34.163001 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:34.163669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:34.170290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:34.170777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:34.171608 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:34.172051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:34.188008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:34.323969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:34.335212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c470390f-8780-46e0-ad6a-32dfe39a996e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1521 microversion: 2.1 time: 0.175771 Jun 24 10:22:34.336028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 357/716] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:34 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:34.566310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:34.566946 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:34.573788 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:34.574228 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:34.575055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:34.575493 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:34.719922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:34.727982 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:34.729460 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:34.730620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6485927a-1ecb-41f7-8a14-46b0e93de248 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.169033 Jun 24 10:22:34.731382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 360/717] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:34 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:35.354089 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:35.354609 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:35.362720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:35.363189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:35.364069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:35.364392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:35.518440 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:35.527862 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6ae59f72-ee7d-4a99-9545-e113caf9247e tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1521 microversion: 2.1 time: 0.177504 Jun 24 10:22:35.528376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 358/718] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:35 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1521 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:35.750025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:35.753239 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:35.758176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:35.758621 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:35.759409 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:35.759830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:36.139465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:36.148038 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:36.149537 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:36.150730 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4603a3d8-f1ab-414d-9233-188adefe10e1 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1733 microversion: 2.20 time: 0.405387 Jun 24 10:22:36.151300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 361/719] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:35 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1733 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:36.545545 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:36.546838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:36.553399 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:36.553807 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:36.554592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:36.555023 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:36.690920 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:36.699084 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-841f5917-c6e9-43c8-9496-06a844bfb0eb tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1521 microversion: 2.1 time: 0.157420 Jun 24 10:22:36.699659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 359/720] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:36 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:37.169734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:37.170400 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:37.172988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=78 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:37.178962 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.179410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.180181 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.180615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.322074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:37.330653 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:37.332179 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:37.333338 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c398c787-4d7b-4563-8b17-fe068840869a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1720 microversion: 2.20 time: 0.167705 Jun 24 10:22:37.333900 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 362/721] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:22:37 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:22:37.687283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:37.688529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:37.695655 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.696108 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.696840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.697278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.741099 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5140fc1b-50e2-45a5-a94a-7c899a7543cc tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.058010 Jun 24 10:22:37.741604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 360/722] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:22:37 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments => generated 371 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:37.775784 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:37.776549 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:37.783842 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.784500 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.785664 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.786486 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.881834 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:37.882347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:37.888703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.889150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.890315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.890840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.921677 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8286c137-f8e6-4b1c-970b-ac373ce154ff tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/633f4597-ea27-46b9-822f-da8a0046c830" status: 200 len: 194 microversion: 2.1 time: 0.043812 Jun 24 10:22:37.922293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 361/723] 10.222.0.64 () {58 vars in 1412 bytes} [Fri Jun 24 10:22:37 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/633f4597-ea27-46b9-822f-da8a0046c830 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:37.931729 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:37.932826 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:37.939197 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.939649 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.940410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:37.940844 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:37.942969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:37.950967 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6e165e91-525d-4d27-9574-ff685fb9a799 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.179559 Jun 24 10:22:37.960654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 363/724] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:37 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:38.029217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lazy-loading 'services' on Instance uuid aceb1aea-5d5b-4319-8492-5f09e252f229 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:22:38.113136 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-576fc04f-206e-49f6-a868-013e467335e8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/633f4597-ea27-46b9-822f-da8a0046c830" status: 202 len: 0 microversion: 2.1 time: 0.184976 Jun 24 10:22:38.113892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 362/725] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:22:37 2022] DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/633f4597-ea27-46b9-822f-da8a0046c830 => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:22:38.968507 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:38.969165 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:38.976470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:38.976944 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:38.977897 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:38.978327 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:39.131466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:39.140485 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0a17284c-fea3-443c-b9f4-eb24b60c0a67 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.175685 Jun 24 10:22:39.142063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 364/726] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:38 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:39.234910 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:39.235663 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:39.242619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:39.243150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:39.243925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:39.244358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:39.274448 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5720d3de-e8d2-41e6-b0d2-68d2baafdf44 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/8de67c7a-9a53-4256-a7ba-caf5eb8bf7e9" status: 200 len: 194 microversion: 2.1 time: 0.044827 Jun 24 10:22:39.275085 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 363/727] 10.222.0.64 () {58 vars in 1412 bytes} [Fri Jun 24 10:22:39 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/8de67c7a-9a53-4256-a7ba-caf5eb8bf7e9 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:22:39.285316 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:39.285814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:39.292506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:39.292939 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:39.293736 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:39.294176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:39.379545 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lazy-loading 'services' on Instance uuid aceb1aea-5d5b-4319-8492-5f09e252f229 {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:22:39.458252 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e208fc29-5ff3-4582-a3a7-420ceacf59a8 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/8de67c7a-9a53-4256-a7ba-caf5eb8bf7e9" status: 202 len: 0 microversion: 2.1 time: 0.176829 Jun 24 10:22:39.458855 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 365/728] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:22:39 2022] DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments/8de67c7a-9a53-4256-a7ba-caf5eb8bf7e9 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:22:40.157842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:40.158476 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:40.165263 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.165716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.166478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.166954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.306068 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:40.316027 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2184c9ca-fc94-49c1-9a03-3d1022f29365 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.162132 Jun 24 10:22:40.316588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 364/729] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:40 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:40.632767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:40.633829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:40.641157 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.641606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.642377 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.642848 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.676062 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-45d86171-e43b-4707-87d6-f9fda39ef97e tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048191 Jun 24 10:22:40.676603 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 366/730] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:22:40 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:22:40.791668 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:40.793125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:40.801791 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.802239 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.803028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.803461 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.832467 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2888b5d5-df90-4ea9-aeee-018f2c825dab tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047214 Jun 24 10:22:40.832918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 365/731] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:22:40 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:22:40.896864 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:40.897366 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:40.903940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.904381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.905137 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:40.905567 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:40.931086 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:22:41.018784 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b2efe162-c5ce-4b5b-ba1c-f5a38a2f7007 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 204 len: 0 microversion: 2.1 time: 0.128491 Jun 24 10:22:41.019414 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 367/732] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:22:40 2022] DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:22:41.028400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:41.029021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:41.035436 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:41.035889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:41.036659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:41.037078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:41.181141 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:41.191016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9eb79f5a-a92a-46ab-8314-4c20fadef677 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1673 microversion: 2.1 time: 0.166684 Jun 24 10:22:41.191574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 366/733] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:41 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:22:41.335055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:41.335751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:41.344458 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:41.345066 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:41.345967 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:41.346685 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:41.349329 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:41.491955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:41.503887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3710ec2e-a372-42f6-a73d-cce023df2fbe tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.173014 Jun 24 10:22:41.504635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 368/734] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:41 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:42.213124 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:42.213733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:42.216414 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=86 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:42.222106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:42.222558 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:42.223680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:42.224118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:42.363402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:42.372278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f9494ebc-59b4-4358-ad6e-7df12cb108a7 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1673 microversion: 2.1 time: 0.166632 Jun 24 10:22:42.372834 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 367/735] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:42 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1673 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:42.523259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:42.523896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:42.530847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:42.531288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:42.532035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:42.532461 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:42.682476 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:42.690417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5b83e476-f75e-445c-b0a5-520810c4997c tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.172445 Jun 24 10:22:42.691396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 369/736] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:42 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:43.389537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:43.390157 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:43.396858 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:43.397306 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:43.398106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:43.398548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:43.466406 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ca14b36fc754fe9b24abdfecf0f64c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a33a4f77f0ae4dc09d4f8c29babf3b03', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:43.484464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-332864da-a815-4b50-be69-81efd2b400a3 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 200 len: 1606 microversion: 2.1 time: 0.089056 Jun 24 10:22:43.484464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 368/737] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:43 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:43.708818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:43.710202 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:43.722592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:43.723116 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:43.724113 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:43.724630 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:43.725177 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-f1d864aa-a785-478b-88e4-866a517d6b6b req-27c0b4e4-85e7-402f-928f-2478922085f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aceb1aea-5d5b-4319-8492-5f09e252f229", "name": "network-vif-deleted", "tag": "df594e9b-d73f-4c5c-acde-1ee318cc8d21"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:43.739045 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f1d864aa-a785-478b-88e4-866a517d6b6b req-27c0b4e4-85e7-402f-928f-2478922085f1 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:43.739797 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f1d864aa-a785-478b-88e4-866a517d6b6b req-27c0b4e4-85e7-402f-928f-2478922085f1 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:43.752975 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-f1d864aa-a785-478b-88e4-866a517d6b6b req-27c0b4e4-85e7-402f-928f-2478922085f1 service nova] Creating event network-vif-deleted:df594e9b-d73f-4c5c-acde-1ee318cc8d21 for instance aceb1aea-5d5b-4319-8492-5f09e252f229 on hv-cinder-84713 Jun 24 10:22:43.762069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-f1d864aa-a785-478b-88e4-866a517d6b6b req-27c0b4e4-85e7-402f-928f-2478922085f1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043759 Jun 24 10:22:43.762670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 369/738] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:43.901063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:43.913969 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ed9b8ef6-58a8-4acf-8ecf-47e6ec3e3b3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.209730 Jun 24 10:22:43.915915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 370/739] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:43 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:44.493537 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:44.494236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:44.501065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:44.501551 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:44.502335 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:44.502796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:44.519473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] HTTP exception thrown: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Request method failure captured: Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 HTTP/1.1 Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY71bBmzQ9RuB5L45nlXl3-E435ze0k8C5PRUKntJrVnTqPTLbGlQKGZFX1iQKD97TZ_KLIcEcVO87ZGJ2txUCwIr-3Db3GDS2Ps-FpSRpm9OwLnXZOgxLbJYW5XDSubCTb8fVV1dGnGEZjyxp7qdNhgKMr8WrId7FXPAHFUk77T3PA Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:22:44.521658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a33a4f77f0ae4dc09d4f8c29babf3b03", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}] Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 6ca14b36fc754fe9b24abdfecf0f64c0 Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:44.524022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'aceb1aea-5d5b-4319-8492-5f09e252f229'} Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:22:44.524972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:44.526271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:44.528728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Returning 404 to user: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:22:44.528728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-81656d10-1024-4c31-a0ea-6a81c27e1bfe tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 404 len: 111 microversion: 2.1 time: 0.034591 Jun 24 10:22:44.528728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 370/740] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:44 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:22:44.533000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d7d2f0c6-d210-4893-a50b-e3d01cdaa145 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '.version_select at 0x7f37749b4e50>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:44.552795 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d7d2f0c6-d210-4893-a50b-e3d01cdaa145 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530138725" status: 202 len: 0 microversion: 2.1 time: 0.024012 Jun 24 10:22:44.553695 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 371/741] 10.222.0.64 () {58 vars in 1220 bytes} [Fri Jun 24 10:22:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1530138725 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:22:44.934614 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:44.935338 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:44.943223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:44.943664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:44.944567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:44.945173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:45.145227 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:45.153376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0adfb2c1-c484-4656-bf31-a4be0f733e75 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.222775 Jun 24 10:22:45.153949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 371/742] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:44 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:46.175907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:46.176819 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:46.184762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:46.185218 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:46.185979 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:46.186418 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:46.334738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:46.342908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e7d8dd08-91c5-4c0d-a00d-5524fb07ca3d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.174135 Jun 24 10:22:46.343466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 372/743] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:46 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:47.361181 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:47.361739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:47.368944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:47.369398 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:47.370167 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:47.370604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:47.512849 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:47.523757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9dee4e8e-3367-4863-895f-5e875e909eab tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.166425 Jun 24 10:22:47.524420 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 372/744] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:47 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:47.577650 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:47.578169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:47.585367 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:47.585810 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:47.586557 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:47.587017 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:47.601099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] HTTP exception thrown: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Request method failure captured: Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 HTTP/1.1 Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY71bBmzQ9RuB5L45nlXl3-E435ze0k8C5PRUKntJrVnTqPTLbGlQKGZFX1iQKD97TZ_KLIcEcVO87ZGJ2txUCwIr-3Db3GDS2Ps-FpSRpm9OwLnXZOgxLbJYW5XDSubCTb8fVV1dGnGEZjyxp7qdNhgKMr8WrId7FXPAHFUk77T3PA Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:22:47.602751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a33a4f77f0ae4dc09d4f8c29babf3b03", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}] Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 6ca14b36fc754fe9b24abdfecf0f64c0 Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.604173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'aceb1aea-5d5b-4319-8492-5f09e252f229'} Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:22:47.605177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.606751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.608394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Returning 404 to user: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:22:47.608394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-227157a1-0905-4513-bb21-b31397482d52 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 404 len: 111 microversion: 2.1 time: 0.030393 Jun 24 10:22:47.608394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 373/745] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:22:47 2022] DELETE /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:22:47.613447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:47.614078 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: aceb1aea-5d5b-4319-8492-5f09e252f229] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:47.621136 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:47.621575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:47.622320 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:47.622757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:47.637360 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] HTTP exception thrown: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Request method failure captured: Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 HTTP/1.1 Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY71bBmzQ9RuB5L45nlXl3-E435ze0k8C5PRUKntJrVnTqPTLbGlQKGZFX1iQKD97TZ_KLIcEcVO87ZGJ2txUCwIr-3Db3GDS2Ps-FpSRpm9OwLnXZOgxLbJYW5XDSubCTb8fVV1dGnGEZjyxp7qdNhgKMr8WrId7FXPAHFUk77T3PA Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:22:47.638956 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a33a4f77f0ae4dc09d4f8c29babf3b03", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}] Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 6ca14b36fc754fe9b24abdfecf0f64c0 Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.640664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'aceb1aea-5d5b-4319-8492-5f09e252f229'} Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:22:47.641800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. Jun 24 10:22:47.643305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:47.644661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Returning 404 to user: Instance aceb1aea-5d5b-4319-8492-5f09e252f229 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:22:47.644661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d8e76280-abc7-4b4e-b944-da3ac610cd7c tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229" status: 404 len: 111 microversion: 2.1 time: 0.031266 Jun 24 10:22:47.644661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 373/746] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:47 2022] GET /compute/v2.1/servers/aceb1aea-5d5b-4319-8492-5f09e252f229 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:22:47.994570 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-f7cb1d48-cb56-44fd-95e6-bbe070e94e2d req-c86f44e2-4a1b-4ba4-b916-80f8373767c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "name": "network-vif-plugged", "status": "completed", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:48.002779 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-f7cb1d48-cb56-44fd-95e6-bbe070e94e2d req-c86f44e2-4a1b-4ba4-b916-80f8373767c5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.003224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-f7cb1d48-cb56-44fd-95e6-bbe070e94e2d req-c86f44e2-4a1b-4ba4-b916-80f8373767c5 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.019417 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-f7cb1d48-cb56-44fd-95e6-bbe070e94e2d req-c86f44e2-4a1b-4ba4-b916-80f8373767c5 service nova] Creating event network-vif-plugged:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:22:48.024900 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-f7cb1d48-cb56-44fd-95e6-bbe070e94e2d req-c86f44e2-4a1b-4ba4-b916-80f8373767c5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034696 Jun 24 10:22:48.025831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 374/747] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:22:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:22:48.548260 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:48.549001 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:48.558294 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.558734 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.559559 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.560000 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.714949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:48.722740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0088236e-b576-4414-9020-6bcc624a741d tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1577 microversion: 2.1 time: 0.181001 Jun 24 10:22:48.723306 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 374/748] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:48 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:48.785532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:48.786076 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:48.793708 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.794150 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.795039 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.795365 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.809476 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] HTTP exception thrown: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Request method failure captured: Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 HTTP/1.1 Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY71bBmzQ9RuB5L45nlXl3-E435ze0k8C5PRUKntJrVnTqPTLbGlQKGZFX1iQKD97TZ_KLIcEcVO87ZGJ2txUCwIr-3Db3GDS2Ps-FpSRpm9OwLnXZOgxLbJYW5XDSubCTb8fVV1dGnGEZjyxp7qdNhgKMr8WrId7FXPAHFUk77T3PA Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:22:48.811134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a33a4f77f0ae4dc09d4f8c29babf3b03", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}] Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 6ca14b36fc754fe9b24abdfecf0f64c0 Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.812442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1'} Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:22:48.813289 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.814824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.816440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Returning 404 to user: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:22:48.816440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e79978b6-fc9a-4766-95f2-9d0b00d42251 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 404 len: 111 microversion: 2.1 time: 0.031646 Jun 24 10:22:48.816440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 375/749] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:22:48 2022] DELETE /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:22:48.823198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:48.823840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] [instance: e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:48.830189 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.830624 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.831399 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:48.831841 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:48.845934 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] HTTP exception thrown: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Request method failure captured: Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 HTTP/1.1 Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY71bBmzQ9RuB5L45nlXl3-E435ze0k8C5PRUKntJrVnTqPTLbGlQKGZFX1iQKD97TZ_KLIcEcVO87ZGJ2txUCwIr-3Db3GDS2Ps-FpSRpm9OwLnXZOgxLbJYW5XDSubCTb8fVV1dGnGEZjyxp7qdNhgKMr8WrId7FXPAHFUk77T3PA Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:22:48.847549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a33a4f77f0ae4dc09d4f8c29babf3b03", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a33a4f77f0ae4dc09d4f8c29babf3b03"}]}] Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: a33a4f77f0ae4dc09d4f8c29babf3b03 Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeTestJSON-488963523 Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 6ca14b36fc754fe9b24abdfecf0f64c0 Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeTestJSON-488963523-project Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.849201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1'} Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:22:48.850286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. Jun 24 10:22:48.851901 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:22:48.857337 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] Returning 404 to user: Instance e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:22:48.857337 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-75e17fbd-1393-4a36-b1ab-501df77a4491 tempest-AttachVolumeTestJSON-488963523 tempest-AttachVolumeTestJSON-488963523-project] 10.222.0.64 "GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1" status: 404 len: 111 microversion: 2.1 time: 0.030247 Jun 24 10:22:48.857337 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 375/750] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:48 2022] GET /compute/v2.1/servers/e3be66ae-a25d-46c4-b8b1-5e35eb49f8d1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:22:49.740762 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:22:49.741379 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:22:49.754380 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:49.755026 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:49.755795 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:22:49.756230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:22:49.940510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:22:49.950863 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b80141ca-2600-4743-ae43-4d05819e17c0 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1564 microversion: 2.1 time: 0.214321 Jun 24 10:22:49.951638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 376/751] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:22:49 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1564 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:22:58.237569 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-59675d10-88fb-4f79-81dc-732f795f9cc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: .version_select at 0x7f37749b5d30>, body: {"keypair": {"name": "tempest-keypair-446265766", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJf9loylVvlouBwcZ5NDvHJX5bioJj2UAkdcimFPVzHr3V8m1GmdR6yfKb8OI7mn72L7lnf1JyjY8TDaqfHBCxJ6SJHrlHHxGGsmlz1fRLbxSlLB6AbpdpNZpP52Sk1YNw=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:58.250930 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-59675d10-88fb-4f79-81dc-732f795f9cc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:22:58.257794 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-59675d10-88fb-4f79-81dc-732f795f9cc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:22:58.284188 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-59675d10-88fb-4f79-81dc-732f795f9cc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.202946 Jun 24 10:22:58.290223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 376/752] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:22:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:22:59.740675 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1368618781", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62d2509b-2c7f-4b5f-9593-650742984d82"}], "security_groups": [{"name": "tempest-securitygroup--1958928967"}], "key_name": "tempest-keypair-446265766", "user_data": "}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:22:59.756115 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:22:59.872966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] validate_networks() for [('62d2509b-2c7f-4b5f-9593-650742984d82', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:22:59.945839 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=35 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:00.284263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:23:00.285184 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:23:00.286202 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:23:00.286963 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:23:00.287675 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:23:00.302144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:00.303231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:00.304559 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:00.305359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:00.336429 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:23:00.344742 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:23:00.363467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:23:00.367613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:23:00.443191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a5a7c025-a4f8-4bc7-bcb8-6ade901265e3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.707657 Jun 24 10:23:00.451523 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 377/753] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:22:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:23:00.453718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:00.458873 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2b2d32f3-2ea4-44cc-af4e-823924fc7da2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:00.459493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2b2d32f3-2ea4-44cc-af4e-823924fc7da2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:00.548489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2b2d32f3-2ea4-44cc-af4e-823924fc7da2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:00.561737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2b2d32f3-2ea4-44cc-af4e-823924fc7da2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1241 microversion: 2.1 time: 0.108753 Jun 24 10:23:00.577029 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 377/754] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:00 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1241 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:01.586992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:01.588461 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:01.595304 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:01.595895 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:01.596526 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:01.597111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:01.680629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:01.695363 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-488a22b0-7eac-4ff9-942b-aaca2c0b9758 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1293 microversion: 2.1 time: 0.114165 Jun 24 10:23:01.697256 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 378/755] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:01 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1293 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:02.718837 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:02.720234 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:02.728493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:02.730246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:02.731659 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:02.733007 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:02.872174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:02.880245 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-becdb2fa-2dc1-4e5d-9ec0-04f9c0e690b7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1367 microversion: 2.1 time: 0.169853 Jun 24 10:23:02.880938 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 378/756] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:02 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:03.287491 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-340e955f-749f-4c50-96be-56281e695002 req-b3b065e5-15a4-412b-a808-ded69d19fe0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725b1a67-bbbe-48c8-8838-a7b65cedf8da", "tag": "80524936-44ce-4c42-b54e-f60f40be9414"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:03.306887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-340e955f-749f-4c50-96be-56281e695002 req-b3b065e5-15a4-412b-a808-ded69d19fe0b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:03.311270 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-340e955f-749f-4c50-96be-56281e695002 req-b3b065e5-15a4-412b-a808-ded69d19fe0b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:03.323470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-340e955f-749f-4c50-96be-56281e695002 req-b3b065e5-15a4-412b-a808-ded69d19fe0b service nova] Creating event network-changed:80524936-44ce-4c42-b54e-f60f40be9414 for instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da on hv-cinder-84713 Jun 24 10:23:03.328746 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-340e955f-749f-4c50-96be-56281e695002 req-b3b065e5-15a4-412b-a808-ded69d19fe0b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051480 Jun 24 10:23:03.329324 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 379/757] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:23:03.898271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:03.899833 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:03.910658 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:03.911105 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:03.911893 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:03.912321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:04.049164 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:04.056955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-762b9a13-ac27-456d-b624-4c58a2290ee5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1367 microversion: 2.1 time: 0.163188 Jun 24 10:23:04.057484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 379/758] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:03 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:05.076231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:05.077010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:05.088926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:05.089542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:05.091011 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:05.091907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:05.225466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:05.233499 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f5d3db93-13f5-44a4-ab37-c02ad5fdb20a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1367 microversion: 2.1 time: 0.162303 Jun 24 10:23:05.234036 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 380/759] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:05 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:06.251144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:06.251745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:06.259001 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:06.259552 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:06.260313 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:06.260741 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:06.402071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:06.410139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9df2cf3e-c534-455b-a892-cadc1bfc7bcc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1367 microversion: 2.1 time: 0.163016 Jun 24 10:23:06.411191 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 380/760] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:06 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:06.476217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1204944247"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:06.477090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:06.483735 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:06.484446 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:06.485206 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:06.485637 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:06.620823 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.network.security_group_api [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Removing security group 5f9df3e4-d2c7-4c7e-99dc-2ca13630ed97 from port 9b477745-37af-4221-acf2-e595e7642fe8 Jun 24 10:23:07.002572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c4499ced-380a-4222-8b69-890985bb84d1 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/action" status: 202 len: 0 microversion: 2.1 time: 0.530191 Jun 24 10:23:07.003683 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 381/761] 10.222.0.64 () {60 vars in 1277 bytes} [Fri Jun 24 10:23:06 2022] POST /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:23:07.018125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-67d780ef-c5ec-4569-9f52-110e54cd64ab req-0fe01288-0192-472f-83e3-0ac0a2cef7a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:07.047707 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-67d780ef-c5ec-4569-9f52-110e54cd64ab req-0fe01288-0192-472f-83e3-0ac0a2cef7a9 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:07.048867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-67d780ef-c5ec-4569-9f52-110e54cd64ab req-0fe01288-0192-472f-83e3-0ac0a2cef7a9 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:07.072533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-67d780ef-c5ec-4569-9f52-110e54cd64ab req-0fe01288-0192-472f-83e3-0ac0a2cef7a9 service nova] Creating event network-changed:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:23:07.083475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-67d780ef-c5ec-4569-9f52-110e54cd64ab req-0fe01288-0192-472f-83e3-0ac0a2cef7a9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070979 Jun 24 10:23:07.084607 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 381/762] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:23:07.435132 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:07.436950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:07.463885 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:07.466199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:07.469329 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:07.470873 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:07.752261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:07.765184 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-4c4f8d27-c845-430e-8c81-108dbb7febc7 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1367 microversion: 2.1 time: 0.339650 Jun 24 10:23:07.766162 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 382/763] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:07 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1367 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:08.126897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-ea420e19-a38f-4a64-afda-34f24fa35030 req-1c8e9a5c-75d2-41cb-9b7f-b9df09f079b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725b1a67-bbbe-48c8-8838-a7b65cedf8da", "name": "network-vif-plugged", "status": "completed", "tag": "80524936-44ce-4c42-b54e-f60f40be9414"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:08.145332 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-ea420e19-a38f-4a64-afda-34f24fa35030 req-1c8e9a5c-75d2-41cb-9b7f-b9df09f079b2 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.146056 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-ea420e19-a38f-4a64-afda-34f24fa35030 req-1c8e9a5c-75d2-41cb-9b7f-b9df09f079b2 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.157893 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-ea420e19-a38f-4a64-afda-34f24fa35030 req-1c8e9a5c-75d2-41cb-9b7f-b9df09f079b2 service nova] Creating event network-vif-plugged:80524936-44ce-4c42-b54e-f60f40be9414 for instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da on hv-cinder-84713 Jun 24 10:23:08.163070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-ea420e19-a38f-4a64-afda-34f24fa35030 req-1c8e9a5c-75d2-41cb-9b7f-b9df09f079b2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041708 Jun 24 10:23:08.163668 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 382/764] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:23:08.720804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:08.721378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:08.728425 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.728868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.729649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.730076 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.792376 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:08.793707 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:08.803954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.804624 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.806357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.807154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.820316 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lazy-loading 'services' on Instance uuid 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:23:08.913895 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-51a8316d-d4cf-4890-bad7-6cbcfccd46ee tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments/349d72c8-fa1b-423a-81cf-3c6b7558ae55" status: 202 len: 0 microversion: 2.1 time: 0.196408 Jun 24 10:23:08.914515 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 383/765] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:23:08 2022] DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments/349d72c8-fa1b-423a-81cf-3c6b7558ae55 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:23:08.924971 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:08.926226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:08.933188 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.933637 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.934427 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:08.934912 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:08.965248 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f1a6bcae-8a81-465c-87e4-6041e9b655c7 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044722 Jun 24 10:23:08.966005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 384/766] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:23:08 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:23:09.009090 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:09.019283 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a242aeaa-11ab-49a7-adf9-ab08292a058e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1367 microversion: 2.1 time: 0.232543 Jun 24 10:23:09.019999 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 383/767] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:08 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:09.102397 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-e87b922e-de41-4bd7-87bb-2596ce18085f req-8d639c27-79f2-4960-821c-674a7d6e3851 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:09.111080 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e87b922e-de41-4bd7-87bb-2596ce18085f req-8d639c27-79f2-4960-821c-674a7d6e3851 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:09.111568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-e87b922e-de41-4bd7-87bb-2596ce18085f req-8d639c27-79f2-4960-821c-674a7d6e3851 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:09.124088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-e87b922e-de41-4bd7-87bb-2596ce18085f req-8d639c27-79f2-4960-821c-674a7d6e3851 service nova] Creating event network-changed:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:23:09.129286 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-e87b922e-de41-4bd7-87bb-2596ce18085f req-8d639c27-79f2-4960-821c-674a7d6e3851 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031570 Jun 24 10:23:09.129852 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 385/768] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:23:09.980129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:09.981324 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:09.988692 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:09.989214 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:09.989988 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:09.990426 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.021026 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3de7a94f-fee5-4e05-bc6a-9fdb5757b23e tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045327 Jun 24 10:23:10.021587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 384/769] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:23:09 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:23:10.038594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:10.039349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:10.047010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.047457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.048224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.048654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.217470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:10.237693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-dc6a3d61-fbe2-426f-8d64-8c3f68db2cbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1556 microversion: 2.1 time: 0.203581 Jun 24 10:23:10.238360 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 386/770] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:10 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1556 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:10.256473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:10.257133 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:10.268838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.269477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.270916 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.272063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.369047 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-aec35e8d-b31f-488f-a293-c573303176a8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118184 Jun 24 10:23:10.369643 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 385/771] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:23:10 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:23:10.761589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:10.763153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:10.766382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:10.767299 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=6 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:10.773639 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.774950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.776625 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.777313 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.815210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-77ca9b2d-9fb1-4787-ae6c-2b9a3a852ede tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.057558 Jun 24 10:23:10.816115 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 387/772] 10.222.0.64 () {60 vars in 1342 bytes} [Fri Jun 24 10:23:10 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:10.887144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:10.892419 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:10.893049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:10.900540 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.901127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.902076 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:10.902602 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:10.929262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:23:11.038422 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:11.041208 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:11.055712 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.057479 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.058906 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.060113 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.066036 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e777f1ea-b26a-4a63-ba6e-23a4e58b889e tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 204 len: 0 microversion: 2.20 time: 0.179130 Jun 24 10:23:11.067390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 386/773] 10.222.0.64 () {60 vars in 1279 bytes} [Fri Jun 24 10:23:10 2022] DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:23:11.080517 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:11.082380 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:11.097319 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.098167 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.099673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.100625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.126277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5d9e0d52-5134-42c3-90c6-50c3f18ce259 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.095301 Jun 24 10:23:11.135712 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 388/774] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:23:11 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments => generated 25 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:23:11.144884 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:11.145921 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:11.156540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.157642 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.159040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.159685 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.266342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] HTTP exception thrown: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 is not attached to volume 349d72c8-fa1b-423a-81cf-3c6b7558ae55 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Request method failure captured: Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments/349d72c8-fa1b-423a-81cf-3c6b7558ae55 HTTP/1.1 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZAJAWcW8bxcRUHy2TOOdm1ahV-OMak-ptW0igm1CONpq15fAB8RuB7LWCGQlqvvqQZ5Toy6fF5tZ2LeORcEEJZvNxmvZSwrd6A2N0I7V4uu-eyFVT_-wx2aGThlQ1XPN_LJMCOkMxtYgv4XdAu1VdGACgy0SU5HCMbTQWupCqrlJ4U Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 34f04f4ab2294464bdc83acecb4d9a79 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-TestMinimumBasicScenario-270575971 Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:23:11.272968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/34f04f4ab2294464bdc83acecb4d9a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_34f04f4ab2294464bdc83acecb4d9a79", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/34f04f4ab2294464bdc83acecb4d9a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/34f04f4ab2294464bdc83acecb4d9a79"}]}] Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-TestMinimumBasicScenario-270575971 Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 34f04f4ab2294464bdc83acecb4d9a79 Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-TestMinimumBasicScenario-270575971 Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-TestMinimumBasicScenario-270575971-project Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: ef90ff4734c249ab965ebf920270b20b Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-TestMinimumBasicScenario-270575971-project Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:23:11.274654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 is not attached to volume 349d72c8-fa1b-423a-81cf-3c6b7558ae55 Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'server_id': '53ffd130-4813-4e8e-a43e-56bbe1ee7b67', 'id': '349d72c8-fa1b-423a-81cf-3c6b7558ae55'} Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 349d72c8-fa1b-423a-81cf-3c6b7558ae55. Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:11.275600 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 is not attached to volume 349d72c8-fa1b-423a-81cf-3c6b7558ae55 Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 is not attached to volume 349d72c8-fa1b-423a-81cf-3c6b7558ae55 Jun 24 10:23:11.277141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:11.280862 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Returning 404 to user: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 is not attached to volume 349d72c8-fa1b-423a-81cf-3c6b7558ae55 {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:11.281946 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-41795e82-cb5f-4e35-bb70-d026f7859a18 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments/349d72c8-fa1b-423a-81cf-3c6b7558ae55" status: 404 len: 154 microversion: 2.1 time: 0.144451 Jun 24 10:23:11.283020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 389/775] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:23:11 2022] DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67/os-volume_attachments/349d72c8-fa1b-423a-81cf-3c6b7558ae55 => generated 154 bytes in 146 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:23:11.412798 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:11.421716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:11.423247 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:11.424437 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1661526f-b6c6-4ca0-aaf9-60c459e2157a tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.351601 Jun 24 10:23:11.425230 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 387/776] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:11 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:23:11.661210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-353ff92c-0e37-4c81-be5f-233baa115d8b req-85eadba8-9363-42a6-83ee-ac54594b5df6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725b1a67-bbbe-48c8-8838-a7b65cedf8da", "tag": "80524936-44ce-4c42-b54e-f60f40be9414"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:11.670069 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-353ff92c-0e37-4c81-be5f-233baa115d8b req-85eadba8-9363-42a6-83ee-ac54594b5df6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:11.670659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-353ff92c-0e37-4c81-be5f-233baa115d8b req-85eadba8-9363-42a6-83ee-ac54594b5df6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:11.683744 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-353ff92c-0e37-4c81-be5f-233baa115d8b req-85eadba8-9363-42a6-83ee-ac54594b5df6 service nova] Creating event network-changed:80524936-44ce-4c42-b54e-f60f40be9414 for instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da on hv-cinder-84713 Jun 24 10:23:11.688955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-353ff92c-0e37-4c81-be5f-233baa115d8b req-85eadba8-9363-42a6-83ee-ac54594b5df6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031516 Jun 24 10:23:11.689643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 390/777] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:23:12.449651 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:12.450455 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:12.453193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:12.459493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:12.463634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:12.463634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:12.463634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:12.518915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:12.520371 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:12.527724 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:12.529475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:12.529475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:12.529899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:12.580089 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:23:12.699383 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-59e1c7ae-254e-46ad-9c4e-7c5fd77942bb tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 204 len: 0 microversion: 2.1 time: 0.181982 Jun 24 10:23:12.703084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 391/778] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:23:12 2022] DELETE /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:23:12.709341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:12.713197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:12.713976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:12.721798 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:12.722534 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:12.723517 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:12.724098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:12.728535 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:12.730127 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:12.731438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-56147e7d-4f81-4735-802e-b6a5dc3f7952 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1726 microversion: 2.20 time: 0.293027 Jun 24 10:23:12.732088 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 388/779] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:12 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1726 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:23:12.909450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:12.918187 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c31f7596-1622-432a-9685-96c01477a16a tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1553 microversion: 2.1 time: 0.210232 Jun 24 10:23:12.918790 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 392/780] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:12 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1553 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:13.620380 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-8ff6b255-6350-4ab2-8bc4-6472a0342958 req-ce047cce-7c5b-4ea7-8078-29b60483e627 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a2ba100-192e-4c39-a43a-93be37df4e63", "name": "network-vif-deleted", "tag": "44c57577-b7f4-4772-ade3-5e9b2dded200"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:13.628696 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-8ff6b255-6350-4ab2-8bc4-6472a0342958 req-ce047cce-7c5b-4ea7-8078-29b60483e627 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:13.629148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-8ff6b255-6350-4ab2-8bc4-6472a0342958 req-ce047cce-7c5b-4ea7-8078-29b60483e627 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:13.642032 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-8ff6b255-6350-4ab2-8bc4-6472a0342958 req-ce047cce-7c5b-4ea7-8078-29b60483e627 service nova] Creating event network-vif-deleted:44c57577-b7f4-4772-ade3-5e9b2dded200 for instance 6a2ba100-192e-4c39-a43a-93be37df4e63 on hv-cinder-84713 Jun 24 10:23:13.647318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-8ff6b255-6350-4ab2-8bc4-6472a0342958 req-ce047cce-7c5b-4ea7-8078-29b60483e627 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030540 Jun 24 10:23:13.652028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 389/781] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:23:13.749722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:13.751032 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:13.758552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:13.759030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:13.760262 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:13.760697 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:13.845899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:13.855537 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:13.857023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:13.858185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b7714aed-e45b-4f42-a2cb-24e6dab29fd6 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1658 microversion: 2.20 time: 0.112546 Jun 24 10:23:13.858751 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 393/782] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:13 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1658 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 24 10:23:13.938469 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:13.939335 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:13.947326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:13.948038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:13.949008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:13.949511 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:14.102853 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:14.115900 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0a182fcb-bb1f-40f5-9d58-454009a43883 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1553 microversion: 2.1 time: 0.182503 Jun 24 10:23:14.116949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 390/783] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:13 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:23:14.877159 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:14.877922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:14.885047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:14.885504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:14.886280 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:14.886737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:14.891229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:14.922923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:14.923371 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:14.923914 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lazy-loading 'fault' on Instance uuid 6a2ba100-192e-4c39-a43a-93be37df4e63 {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:23:14.982414 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:14.999127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:15.001578 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0a66b13572904a309d3180afc7278070', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74111042535d44c8a52a4656eb37fa23', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:15.003353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ceb81292-6c5e-4578-9322-782a327d96cb tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 200 len: 1372 microversion: 2.20 time: 0.130162 Jun 24 10:23:15.004192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 394/784] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:14 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 1372 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 24 10:23:15.141063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:15.141939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:15.149969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:15.150845 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:15.151710 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:15.152256 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:15.309957 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef90ff4734c249ab965ebf920270b20b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34f04f4ab2294464bdc83acecb4d9a79', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:23:15.318258 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-45bcc077-a2aa-49ef-a803-64c4b9f08429 tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 200 len: 1553 microversion: 2.1 time: 0.181287 Jun 24 10:23:15.318887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 391/785] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:15 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 1553 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:23:15.662832 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-61db1626-76dc-44aa-9844-f680f9315875 req-1191b072-f65e-4eaa-a21e-531c7068b640 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53ffd130-4813-4e8e-a43e-56bbe1ee7b67", "name": "network-vif-deleted", "tag": "9b477745-37af-4221-acf2-e595e7642fe8"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:15.671748 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-61db1626-76dc-44aa-9844-f680f9315875 req-1191b072-f65e-4eaa-a21e-531c7068b640 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:15.672198 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-61db1626-76dc-44aa-9844-f680f9315875 req-1191b072-f65e-4eaa-a21e-531c7068b640 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:15.685333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-61db1626-76dc-44aa-9844-f680f9315875 req-1191b072-f65e-4eaa-a21e-531c7068b640 service nova] Creating event network-vif-deleted:9b477745-37af-4221-acf2-e595e7642fe8 for instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 on hv-cinder-84713 Jun 24 10:23:15.690582 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-61db1626-76dc-44aa-9844-f680f9315875 req-1191b072-f65e-4eaa-a21e-531c7068b640 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031356 Jun 24 10:23:15.691889 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 395/786] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:23:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:23:16.023382 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:16.023992 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:16.030590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:16.031112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:16.031865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:16.032302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:16.046501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] HTTP exception thrown: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Request method failure captured: Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 HTTP/1.1 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY7vtRfp9yCzJORBUJhhyOReAESustvc57KyjM9a744o7lC90Xg0I1S7plCxGjOXLh6nsKquYR5VVgo4atChBMC8zsglKMCQpOHP6cPWvDveD-Pgg1LswyosxuTzLMXkwOU9A-eJjhWmrmbk2UHq-tqqdTZtngG7d9zzET_9LwH6A98 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:23:16.048236 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_74111042535d44c8a52a4656eb37fa23", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}] Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 0a66b13572904a309d3180afc7278070 Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:16.049894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '6a2ba100-192e-4c39-a43a-93be37df4e63'} Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:16.050829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:16.052150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.053271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Returning 404 to user: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:16.053271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9a8b5483-21f8-4d8c-a1b2-5714c1821435 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 404 len: 111 microversion: 2.20 time: 0.030300 Jun 24 10:23:16.053271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 392/787] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:16 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:23:16.060393 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-25b58025-0a26-42e9-a2e9-1200e7f33bba tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '.version_select at 0x7f3774947ca0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:16.080726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-25b58025-0a26-42e9-a2e9-1200e7f33bba tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376698504" status: 204 len: 0 microversion: 2.20 time: 0.025063 Jun 24 10:23:16.081333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 396/788] 10.222.0.64 () {60 vars in 1261 bytes} [Fri Jun 24 10:23:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1376698504 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 24 10:23:16.339990 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:16.340689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] [instance: 53ffd130-4813-4e8e-a43e-56bbe1ee7b67] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:16.347448 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:16.347891 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:16.348672 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:16.349111 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:16.363390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] HTTP exception thrown: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 could not be found. Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Request method failure captured: Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 HTTP/1.1 Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZAJAWcW8bxcRUHy2TOOdm1ahV-OMak-ptW0igm1CONpq15fAB8RuB7LWCGQlqvvqQZ5Toy6fF5tZ2LeORcEEJZvNxmvZSwrd6A2N0I7V4uu-eyFVT_-wx2aGThlQ1XPN_LJMCOkMxtYgv4XdAu1VdGACgy0SU5HCMbTQWupCqrlJ4U Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 34f04f4ab2294464bdc83acecb4d9a79 Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-TestMinimumBasicScenario-270575971 Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:23:16.364906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/34f04f4ab2294464bdc83acecb4d9a79"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_34f04f4ab2294464bdc83acecb4d9a79", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/34f04f4ab2294464bdc83acecb4d9a79"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/34f04f4ab2294464bdc83acecb4d9a79"}]}] Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-TestMinimumBasicScenario-270575971 Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 34f04f4ab2294464bdc83acecb4d9a79 Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-TestMinimumBasicScenario-270575971 Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-TestMinimumBasicScenario-270575971-project Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: ef90ff4734c249ab965ebf920270b20b Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-TestMinimumBasicScenario-270575971-project Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 could not be found. Jun 24 10:23:16.367494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '53ffd130-4813-4e8e-a43e-56bbe1ee7b67'} Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 could not be found. Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:16.368998 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 could not be found. Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 could not be found. Jun 24 10:23:16.371553 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:16.373764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Returning 404 to user: Instance 53ffd130-4813-4e8e-a43e-56bbe1ee7b67 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:16.373764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2a0495f0-fc03-4e20-8b0e-396827c7e2fd tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67" status: 404 len: 111 microversion: 2.1 time: 0.031010 Jun 24 10:23:16.373764 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 393/789] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:23:16 2022] GET /compute/v2.1/servers/53ffd130-4813-4e8e-a43e-56bbe1ee7b67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:23:16.375589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c394f471-f735-44c9-be6b-ac4804394d5d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] Calling method '.version_select at 0x7f377497dd30>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:16.395270 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c394f471-f735-44c9-be6b-ac4804394d5d tempest-TestMinimumBasicScenario-270575971 tempest-TestMinimumBasicScenario-270575971-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-170699949" status: 202 len: 0 microversion: 2.1 time: 0.023235 Jun 24 10:23:16.396163 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 397/790] 10.222.0.64 () {58 vars in 1268 bytes} [Fri Jun 24 10:23:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-170699949 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:23:17.948837 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:17.949882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:17.963261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:17.964047 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:17.965761 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:17.966371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:17.992691 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] HTTP exception thrown: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Request method failure captured: Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 HTTP/1.1 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY7vtRfp9yCzJORBUJhhyOReAESustvc57KyjM9a744o7lC90Xg0I1S7plCxGjOXLh6nsKquYR5VVgo4atChBMC8zsglKMCQpOHP6cPWvDveD-Pgg1LswyosxuTzLMXkwOU9A-eJjhWmrmbk2UHq-tqqdTZtngG7d9zzET_9LwH6A98 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:23:17.994482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_74111042535d44c8a52a4656eb37fa23", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}] Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 0a66b13572904a309d3180afc7278070 Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:17.997661 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '6a2ba100-192e-4c39-a43a-93be37df4e63'} Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:17.999417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.002297 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.004824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Returning 404 to user: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:18.004824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8199f1e2-2f5c-4a7f-9507-d4d89654983f tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 404 len: 111 microversion: 2.20 time: 0.052630 Jun 24 10:23:18.004824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 394/791] 10.222.0.64 () {60 vars in 1279 bytes} [Fri Jun 24 10:23:17 2022] DELETE /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:23:18.016156 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:18.017540 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: 6a2ba100-192e-4c39-a43a-93be37df4e63] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:18.032776 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:18.033592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:18.034991 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:18.035775 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:18.072972 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] HTTP exception thrown: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Request method failure captured: Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 HTTP/1.1 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY7vtRfp9yCzJORBUJhhyOReAESustvc57KyjM9a744o7lC90Xg0I1S7plCxGjOXLh6nsKquYR5VVgo4atChBMC8zsglKMCQpOHP6cPWvDveD-Pgg1LswyosxuTzLMXkwOU9A-eJjhWmrmbk2UHq-tqqdTZtngG7d9zzET_9LwH6A98 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:23:18.076020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_74111042535d44c8a52a4656eb37fa23", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}] Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 0a66b13572904a309d3180afc7278070 Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.077452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '6a2ba100-192e-4c39-a43a-93be37df4e63'} Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:18.078225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. Jun 24 10:23:18.080127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:18.081926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Returning 404 to user: Instance 6a2ba100-192e-4c39-a43a-93be37df4e63 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:18.081926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b3893b58-e0c6-4abe-a97a-b5048623abb5 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63" status: 404 len: 111 microversion: 2.20 time: 0.071209 Jun 24 10:23:18.084291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 398/792] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:18 2022] GET /compute/v2.1/servers/6a2ba100-192e-4c39-a43a-93be37df4e63 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:23:19.239538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:19.240307 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:19.247522 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:19.247864 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:19.248851 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:19.249278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:19.263848 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] HTTP exception thrown: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Request method failure captured: Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee HTTP/1.1 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY7vtRfp9yCzJORBUJhhyOReAESustvc57KyjM9a744o7lC90Xg0I1S7plCxGjOXLh6nsKquYR5VVgo4atChBMC8zsglKMCQpOHP6cPWvDveD-Pgg1LswyosxuTzLMXkwOU9A-eJjhWmrmbk2UHq-tqqdTZtngG7d9zzET_9LwH6A98 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:23:19.265493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_74111042535d44c8a52a4656eb37fa23", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}] Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 0a66b13572904a309d3180afc7278070 Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.268154 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'cb96a476-856a-400c-8c57-30b98297ebee'} Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:19.269501 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.271865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.274082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Returning 404 to user: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:19.274082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-85cf79ba-cb7b-41c7-bd3a-f987d99c8041 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 404 len: 111 microversion: 2.20 time: 0.032016 Jun 24 10:23:19.274082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 395/793] 10.222.0.64 () {60 vars in 1279 bytes} [Fri Jun 24 10:23:19 2022] DELETE /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:23:19.275759 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:19.276382 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] [instance: cb96a476-856a-400c-8c57-30b98297ebee] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:19.283140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:19.283617 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:19.284381 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:19.284789 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:19.299342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] HTTP exception thrown: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Request method failure captured: Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee HTTP/1.1 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitY7vtRfp9yCzJORBUJhhyOReAESustvc57KyjM9a744o7lC90Xg0I1S7plCxGjOXLh6nsKquYR5VVgo4atChBMC8zsglKMCQpOHP6cPWvDveD-Pgg1LswyosxuTzLMXkwOU9A-eJjhWmrmbk2UHq-tqqdTZtngG7d9zzET_9LwH6A98 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Openstack-Nova-Api-Version: 2.20 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:23:19.300984 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_74111042535d44c8a52a4656eb37fa23", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/74111042535d44c8a52a4656eb37fa23"}]}] Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 74111042535d44c8a52a4656eb37fa23 Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-164554392 Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 0a66b13572904a309d3180afc7278070 Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeShelveTestJSON-164554392-project Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.303531 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'cb96a476-856a-400c-8c57-30b98297ebee'} Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:23:19.305010 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. Jun 24 10:23:19.307948 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:23:19.310677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] Returning 404 to user: Instance cb96a476-856a-400c-8c57-30b98297ebee could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:23:19.310677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3c87a6ce-1abe-43df-a180-6e38d84c5804 tempest-AttachVolumeShelveTestJSON-164554392 tempest-AttachVolumeShelveTestJSON-164554392-project] 10.222.0.64 "GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee" status: 404 len: 111 microversion: 2.20 time: 0.030667 Jun 24 10:23:19.310677 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 399/794] 10.222.0.64 () {60 vars in 1276 bytes} [Fri Jun 24 10:23:19 2022] GET /compute/v2.1/servers/cb96a476-856a-400c-8c57-30b98297ebee => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 24 10:23:48.357500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:23:48.358298 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:48.361760 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=15 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:48.362446 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:48.369223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:48.369717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:48.370547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:48.371011 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:48.399662 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9c0b0897-0ed8-4882-b01a-026137370ebc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/ips" status: 200 len: 148 microversion: 2.1 time: 0.047484 Jun 24 10:23:48.400218 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 396/795] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:23:48 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:23:49.767564 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:49.768919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=12 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:23:49.773174 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "213b47f9-567f-492e-b0d9-2b86a26ff9d6"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:23:49.774260 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:23:49.781384 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:49.781837 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:49.782605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:23:49.783066 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:23:50.031954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-164bfc1f-2a9a-46f1-9fea-a5dfc3589b7d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.265482 Jun 24 10:23:50.032576 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 400/796] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:23:49 2022] POST /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments => generated 194 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:00.789694 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8c5f7228-a2d9-4f15-ae30-4fb4b55b739d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: .version_select at 0x7f3774ae3af0>, body: {"keypair": {"name": "tempest-keypair-517919722", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN7WiAD1IZlB/GTMjf+i5w+K2mgM7Aubr6iaH/tINYlSHu4IPn0Z+RE1/GGXZzg95taJWfq12KrItQ1+9DaHiM3Eyc606YZ3k+1OiRO/u8R3sX6+1KuOiKl/rMC1JPRVEQ=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:00.794752 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:00.795603 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=4 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:00.808482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-8c5f7228-a2d9-4f15-ae30-4fb4b55b739d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:24:00.812601 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-8c5f7228-a2d9-4f15-ae30-4fb4b55b739d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:24:00.835751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8c5f7228-a2d9-4f15-ae30-4fb4b55b739d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050406 Jun 24 10:24:00.836346 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 397/797] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:24:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:24:02.249609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:02.251387 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:02.256746 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1784642262", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62d2509b-2c7f-4b5f-9593-650742984d82"}], "security_groups": [{"name": "tempest-securitygroup--323428391"}], "key_name": "tempest-keypair-517919722", "user_data": "}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:02.383491 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] validate_networks() for [('62d2509b-2c7f-4b5f-9593-650742984d82', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:24:02.802415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:24:02.802883 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:24:02.803350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:24:02.803755 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:24:02.804181 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:24:02.813664 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:02.814104 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:02.814964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:02.815393 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:02.832288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:24:02.836282 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:24:02.847847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:24:02.850172 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:24:02.904587 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c56ed89f-b2ac-4a98-b2b6-ce523a94cc82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.656380 Jun 24 10:24:02.905359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 401/798] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:24:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 658 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:24:02.919200 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b4c880a7-8d49-49d6-ba37-13152207191d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:02.919798 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b4c880a7-8d49-49d6-ba37-13152207191d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:02.981572 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b4c880a7-8d49-49d6-ba37-13152207191d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:02.989688 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b4c880a7-8d49-49d6-ba37-13152207191d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1241 microversion: 2.1 time: 0.075734 Jun 24 10:24:02.990813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 398/799] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:02 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:04.009535 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:04.010102 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:04.019543 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:04.020000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:04.020834 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:04.021467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:04.085506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:04.094262 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9aa9aa0d-9daa-4a43-93ed-8d61c057168b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1311 microversion: 2.1 time: 0.089796 Jun 24 10:24:04.094835 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 402/800] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:04 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1311 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:05.111979 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:05.112698 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:05.119615 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:05.120080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:05.120847 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:05.121334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:05.264816 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:05.273314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c75f636e-d8f9-4dc5-9255-5ae8940d6433 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1366 microversion: 2.1 time: 0.165258 Jun 24 10:24:05.274719 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 399/801] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:05 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:05.453053 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-7d00c7a5-02df-4a80-b74f-d2e3b1d984bb req-8a31af94-0411-4e4c-9a9b-d04b5b03b497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847c5da0-048e-4f9e-bf9b-05be65fafd89", "tag": "c60c2889-7aaf-4585-97c7-7d769ea738cf"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:05.464749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-7d00c7a5-02df-4a80-b74f-d2e3b1d984bb req-8a31af94-0411-4e4c-9a9b-d04b5b03b497 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:05.465508 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-7d00c7a5-02df-4a80-b74f-d2e3b1d984bb req-8a31af94-0411-4e4c-9a9b-d04b5b03b497 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:05.481078 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-7d00c7a5-02df-4a80-b74f-d2e3b1d984bb req-8a31af94-0411-4e4c-9a9b-d04b5b03b497 service nova] Creating event network-changed:c60c2889-7aaf-4585-97c7-7d769ea738cf for instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 on hv-cinder-84713 Jun 24 10:24:05.487919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-7d00c7a5-02df-4a80-b74f-d2e3b1d984bb req-8a31af94-0411-4e4c-9a9b-d04b5b03b497 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039128 Jun 24 10:24:05.488665 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 403/802] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:06.290879 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:06.291503 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:06.305817 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:06.306299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:06.307110 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:06.307547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:06.444955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:06.452647 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ea3d92ff-b1fc-4ec4-9ff5-d8a82f576e62 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1366 microversion: 2.1 time: 0.165734 Jun 24 10:24:06.453402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 400/803] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:06 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:07.471218 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:07.471903 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:07.478431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:07.478907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:07.479657 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:07.480079 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:07.638217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:07.646246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-64787b3c-5630-4c78-a781-a237c529686c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1366 microversion: 2.1 time: 0.180268 Jun 24 10:24:07.646853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 404/804] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:07 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1366 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:24:08.663546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:08.664257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:08.671291 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:08.671828 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:08.672914 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:08.673456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:08.816347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:08.825081 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bed54fb8-f66e-4adc-aa6a-3613a7c2f121 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1366 microversion: 2.1 time: 0.165290 Jun 24 10:24:08.825552 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 401/805] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:08 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:09.508727 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:09.509407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:09.511227 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-2ef0ed28-bfd4-49c1-bdab-fe259ea9b21a req-bb9e1e91-ed86-4f29-85ab-ed93e0f8683b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:09.522387 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2ef0ed28-bfd4-49c1-bdab-fe259ea9b21a req-bb9e1e91-ed86-4f29-85ab-ed93e0f8683b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.522684 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.523276 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.523550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2ef0ed28-bfd4-49c1-bdab-fe259ea9b21a req-bb9e1e91-ed86-4f29-85ab-ed93e0f8683b service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.524139 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.526259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.553674 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-2ef0ed28-bfd4-49c1-bdab-fe259ea9b21a req-bb9e1e91-ed86-4f29-85ab-ed93e0f8683b service nova] Creating event network-changed:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:24:09.560040 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:24:09.560349 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-2ef0ed28-bfd4-49c1-bdab-fe259ea9b21a req-bb9e1e91-ed86-4f29-85ab-ed93e0f8683b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054023 Jun 24 10:24:09.561487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 402/806] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:24:09.691225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-32bd5053-4874-4549-9b1c-67b71486e3f1 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 204 len: 0 microversion: 2.1 time: 0.183480 Jun 24 10:24:09.703454 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:09.704217 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:09.708335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 405/807] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:24:09 2022] DELETE /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:24:09.712917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.713372 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.714202 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.714649 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.844804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:09.845631 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:09.854609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.855364 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.856308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:09.857205 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:09.868541 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:09.878073 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1bb51c5b-634a-45f2-840b-322cf2c5e440 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.180042 Jun 24 10:24:09.878840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 403/808] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:09 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:10.021846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:10.034782 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b8c898e6-b19d-41e1-9ff3-251659b1ba4c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1366 microversion: 2.1 time: 0.193119 Jun 24 10:24:10.035651 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 406/809] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:09 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:24:10.479963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-4d85bd6a-c2aa-4d4f-9c07-c93b1ddfff03 req-026787f4-7d07-4060-a2c3-470c52279d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847c5da0-048e-4f9e-bf9b-05be65fafd89", "name": "network-vif-plugged", "status": "completed", "tag": "c60c2889-7aaf-4585-97c7-7d769ea738cf"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:10.494268 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-4d85bd6a-c2aa-4d4f-9c07-c93b1ddfff03 req-026787f4-7d07-4060-a2c3-470c52279d42 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:10.495109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-4d85bd6a-c2aa-4d4f-9c07-c93b1ddfff03 req-026787f4-7d07-4060-a2c3-470c52279d42 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:10.508375 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-4d85bd6a-c2aa-4d4f-9c07-c93b1ddfff03 req-026787f4-7d07-4060-a2c3-470c52279d42 service nova] Creating event network-vif-plugged:c60c2889-7aaf-4585-97c7-7d769ea738cf for instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 on hv-cinder-84713 Jun 24 10:24:10.513755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-4d85bd6a-c2aa-4d4f-9c07-c93b1ddfff03 req-026787f4-7d07-4060-a2c3-470c52279d42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039208 Jun 24 10:24:10.514785 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 404/810] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:10.896606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:10.897238 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:10.903794 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:10.904240 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:10.904996 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:10.905423 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:11.053191 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:11.054088 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:11.061341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:11.062202 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:11.063709 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:11.064394 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:11.081971 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:11.092278 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-99219450-1813-47be-9d72-9984adcd2674 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1570 microversion: 2.1 time: 0.199830 Jun 24 10:24:11.093214 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 407/811] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:10 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1570 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:11.215050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:11.222639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-47ae51ee-771b-4bdf-bd62-b8295915956c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1366 microversion: 2.1 time: 0.174258 Jun 24 10:24:11.223351 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 405/812] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:11 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:24:12.109544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:12.110940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:12.120620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.124919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.126023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.126633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.178093 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-f60e270a-f758-489e-837f-9533e0f065c7 req-adf4fbf0-7e8c-4a14-80f7-a64255cbf147 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d", "name": "network-vif-deleted", "tag": "0124f28a-1a85-487c-9819-2fad18e6391a"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:12.187112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f60e270a-f758-489e-837f-9533e0f065c7 req-adf4fbf0-7e8c-4a14-80f7-a64255cbf147 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.187551 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-f60e270a-f758-489e-837f-9533e0f065c7 req-adf4fbf0-7e8c-4a14-80f7-a64255cbf147 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.200337 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-f60e270a-f758-489e-837f-9533e0f065c7 req-adf4fbf0-7e8c-4a14-80f7-a64255cbf147 service nova] Creating event network-vif-deleted:0124f28a-1a85-487c-9819-2fad18e6391a for instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d on hv-cinder-84713 Jun 24 10:24:12.206035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-f60e270a-f758-489e-837f-9533e0f065c7 req-adf4fbf0-7e8c-4a14-80f7-a64255cbf147 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032299 Jun 24 10:24:12.207339 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 406/813] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:12.242819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:12.243602 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:12.251243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.251619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.252494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.252972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.303386 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23c7ecdb284d4ad0bda072a87ad8984c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '90f6878fdaaf43b58b92bea357331d2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:12.311079 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c55c498f-32f3-4134-97d3-5d2794d2dbb8 tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 200 len: 1383 microversion: 2.1 time: 0.205375 Jun 24 10:24:12.311727 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 408/814] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:12 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 1383 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:12.494813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:12.504111 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-86370936-7ece-47ab-b351-cab7795eb6fc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1556 microversion: 2.1 time: 0.266166 Jun 24 10:24:12.504790 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 407/815] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:12 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1556 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:12.520982 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:12.521479 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:12.528644 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.529361 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.530304 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:12.530933 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:12.661357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-463396ef-ed97-4f66-8644-5cc20450c239 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.144318 Jun 24 10:24:12.661978 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 409/816] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:24:12 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:13.329261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:13.330046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] [instance: 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:13.334527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:13.339585 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:13.340354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:13.341605 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:13.342424 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:13.373161 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] HTTP exception thrown: Instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d could not be found. Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Request method failure captured: Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d HTTP/1.1 Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitY-Q46Sm96_yYl8zn4ik4XKdWmvIniKssgBNMZEYjvu_z4szTjndL5z6ZXXYJ8Q0v_2IodWACxhFDMK8jc10OSdnClix9XCGz6JnwPAR7M_0_6uX_641PDgAdFVOf16xvAeonc5PsqlYyDsN1ONbY8j4JFM6xIW84KT8Ms620_f0chk Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 90f6878fdaaf43b58b92bea357331d2e Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-TestShelveInstance-1874661713 Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:24:13.375777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/90f6878fdaaf43b58b92bea357331d2e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_90f6878fdaaf43b58b92bea357331d2e", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/90f6878fdaaf43b58b92bea357331d2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/90f6878fdaaf43b58b92bea357331d2e"}]}] Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-TestShelveInstance-1874661713 Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 90f6878fdaaf43b58b92bea357331d2e Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-TestShelveInstance-1874661713 Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-TestShelveInstance-1874661713-project Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 23c7ecdb284d4ad0bda072a87ad8984c Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-TestShelveInstance-1874661713-project Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d could not be found. Jun 24 10:24:13.377806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d'} Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d could not be found. Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:24:13.379600 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d could not be found. Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d could not be found. Jun 24 10:24:13.382201 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:13.383772 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Returning 404 to user: Instance 0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:24:13.383772 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-69d4035f-d302-4c69-9a99-fb703628968a tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d" status: 404 len: 111 microversion: 2.1 time: 0.053134 Jun 24 10:24:13.383772 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 408/817] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:13 2022] GET /compute/v2.1/servers/0d7ffdd4-fd71-4b8c-80b5-66ed5f57053d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:24:13.566186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-af441c35-373d-4f61-81d4-3835438d22dc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] Calling method '.version_select at 0x7f3774947ca0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:13.570590 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:13.571533 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=6 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:13.591889 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-af441c35-373d-4f61-81d4-3835438d22dc tempest-TestShelveInstance-1874661713 tempest-TestShelveInstance-1874661713-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005574597" status: 202 len: 0 microversion: 2.1 time: 0.030351 Jun 24 10:24:13.592539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 410/818] 10.222.0.64 () {58 vars in 1253 bytes} [Fri Jun 24 10:24:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2005574597 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:24:14.526101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1269110138", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "networks": [{"uuid": "403c5ff5-8a5f-4962-8aef-dabb2ed88792"}]}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:14.580296 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] validate_networks() for [('403c5ff5-8a5f-4962-8aef-dabb2ed88792', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:24:15.021836 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:24:15.023054 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:24:15.023781 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:24:15.024706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:24:15.025392 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:24:15.040937 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:15.041676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:15.043343 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:15.044099 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:15.064075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Getting quotas for project 5ea13d1f279d466e9a359c02548494b4. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:24:15.069711 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Getting quotas for user 5ba18b0e8ba74364a104582d296334c6 and project 5ea13d1f279d466e9a359c02548494b4. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:24:15.081581 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:24:15.083915 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:24:15.142881 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5f56942d-9119-4ef2-b18c-836c5d123de7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.620578 Jun 24 10:24:15.144153 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 409/819] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:24:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 622 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:24:15.154876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-cb9aebea-a3f6-44ba-82e0-8f9a11a7cde7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:15.156253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-cb9aebea-a3f6-44ba-82e0-8f9a11a7cde7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:15.196400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-43021e3a-08a3-4d07-ad89-893f766ead23 req-812f1b6e-9431-4ff5-8f1e-3d0c849136a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "847c5da0-048e-4f9e-bf9b-05be65fafd89", "tag": "c60c2889-7aaf-4585-97c7-7d769ea738cf"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:15.213379 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-43021e3a-08a3-4d07-ad89-893f766ead23 req-812f1b6e-9431-4ff5-8f1e-3d0c849136a2 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:15.213823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-43021e3a-08a3-4d07-ad89-893f766ead23 req-812f1b6e-9431-4ff5-8f1e-3d0c849136a2 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:15.240819 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-cb9aebea-a3f6-44ba-82e0-8f9a11a7cde7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:15.246254 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-43021e3a-08a3-4d07-ad89-893f766ead23 req-812f1b6e-9431-4ff5-8f1e-3d0c849136a2 service nova] Creating event network-changed:c60c2889-7aaf-4585-97c7-7d769ea738cf for instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 on hv-cinder-84713 Jun 24 10:24:15.248976 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-cb9aebea-a3f6-44ba-82e0-8f9a11a7cde7 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1219 microversion: 2.1 time: 0.099022 Jun 24 10:24:15.249551 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 411/820] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:15 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1219 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:24:15.252216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-43021e3a-08a3-4d07-ad89-893f766ead23 req-812f1b6e-9431-4ff5-8f1e-3d0c849136a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068342 Jun 24 10:24:15.253253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 410/821] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:16.265392 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:16.266658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:16.273588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:16.274274 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:16.275239 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:16.275826 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:16.346466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:16.354231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a47e1123-2d55-45ae-8904-afe4891aaa35 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1289 microversion: 2.1 time: 0.092614 Jun 24 10:24:16.362792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 412/822] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:16 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1289 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:17.374544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:17.375293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:17.384247 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:17.384601 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:17.385366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:17.385803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:17.634604 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:17.648063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-566f06bd-6dd3-4303-bc5e-b90e02384be6 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1319 microversion: 2.1 time: 0.279111 Jun 24 10:24:17.648656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 411/823] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:17 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1319 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:17.970063 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-63ce7eee-c2d7-4933-a46a-9698a435f0d5 req-d84f772d-d903-458e-8535-b86eeeea1640 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f0a59419-920a-4901-8bb2-b952e741184d", "tag": "37903b9c-fde3-4bdb-ae8f-cbbbad5bee55"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:17.982324 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-63ce7eee-c2d7-4933-a46a-9698a435f0d5 req-d84f772d-d903-458e-8535-b86eeeea1640 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:17.983005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-63ce7eee-c2d7-4933-a46a-9698a435f0d5 req-d84f772d-d903-458e-8535-b86eeeea1640 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:18.015898 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-63ce7eee-c2d7-4933-a46a-9698a435f0d5 req-d84f772d-d903-458e-8535-b86eeeea1640 service nova] Creating event network-changed:37903b9c-fde3-4bdb-ae8f-cbbbad5bee55 for instance f0a59419-920a-4901-8bb2-b952e741184d on hv-cinder-84713 Jun 24 10:24:18.021563 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-63ce7eee-c2d7-4933-a46a-9698a435f0d5 req-d84f772d-d903-458e-8535-b86eeeea1640 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056459 Jun 24 10:24:18.022585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 413/824] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:18.664726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:18.665277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:18.672134 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:18.673287 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:18.674058 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:18.674493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:18.809868 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:18.818366 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-aa5c8e7e-fecd-49c8-b5d2-476776070e09 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1319 microversion: 2.1 time: 0.157611 Jun 24 10:24:18.819378 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 412/825] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:18 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:19.837315 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:19.837981 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:19.844865 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:19.845316 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:19.846087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:19.846523 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:19.983000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:19.991213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8a7fda45-732d-46d6-bb8a-fa4d5554a2bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1319 microversion: 2.1 time: 0.159053 Jun 24 10:24:19.991875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 414/826] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:19 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:21.008939 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:21.009838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:21.017341 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:21.018106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:21.019123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:21.019769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:21.281945 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:21.290449 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-17384680-f87d-42b5-8f8e-1131b1296560 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1319 microversion: 2.1 time: 0.285485 Jun 24 10:24:21.291090 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 413/827] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:21 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1319 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:22.308472 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:22.309080 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:22.315756 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:22.316300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:22.317087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:22.317513 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:22.463296 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:22.472887 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ca6eb3de-c6ef-42a7-9faf-fb4706e25c88 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1319 microversion: 2.1 time: 0.168204 Jun 24 10:24:22.474151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 415/828] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:22 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:22.574982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-8cd7c4e7-34f7-47e3-83a6-c6c9972f329e req-980a3183-5652-4709-8c9e-47c5bfff00a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a59419-920a-4901-8bb2-b952e741184d", "name": "network-vif-plugged", "status": "completed", "tag": "37903b9c-fde3-4bdb-ae8f-cbbbad5bee55"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:22.585417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-8cd7c4e7-34f7-47e3-83a6-c6c9972f329e req-980a3183-5652-4709-8c9e-47c5bfff00a4 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:22.586150 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-8cd7c4e7-34f7-47e3-83a6-c6c9972f329e req-980a3183-5652-4709-8c9e-47c5bfff00a4 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:22.603514 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-8cd7c4e7-34f7-47e3-83a6-c6c9972f329e req-980a3183-5652-4709-8c9e-47c5bfff00a4 service nova] Creating event network-vif-plugged:37903b9c-fde3-4bdb-ae8f-cbbbad5bee55 for instance f0a59419-920a-4901-8bb2-b952e741184d on hv-cinder-84713 Jun 24 10:24:22.612905 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-8cd7c4e7-34f7-47e3-83a6-c6c9972f329e req-980a3183-5652-4709-8c9e-47c5bfff00a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041954 Jun 24 10:24:22.613676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 414/829] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:24:23.491057 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:23.491865 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:23.499837 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:23.500395 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:23.501236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:23.501676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:23.642464 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:23.650103 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-930b93af-ec6e-4041-b92f-82eb8c22a575 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1319 microversion: 2.1 time: 0.163225 Jun 24 10:24:23.650643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 416/830] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:23 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:24.668180 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:24.668871 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:24.677331 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:24.677782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:24.678555 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:24.679035 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:24.813561 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:24.821358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-74ea9a45-d42f-4d34-80b1-66666b99eab4 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1508 microversion: 2.1 time: 0.157579 Jun 24 10:24:24.821926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 415/831] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:24 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:40.012697 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "71b7ff67-dfd3-4abd-b25a-e50cd45e1e5d", "device": "/dev/sdb"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:40.015017 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:40.018908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:40.019714 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:40.020493 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:40.030310 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:40.031007 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:40.032194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:40.032869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:40.450868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6c495bb8-bbc1-4c93-85f3-30d87e0b56ba tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "POST /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.444566 Jun 24 10:24:40.451635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 417/832] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:24:40 2022] POST /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d/os-volume_attachments => generated 194 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:51.343156 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:51.343782 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:51.345851 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:51.346520 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:51.347315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=60,nova_api:INSERT=4 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:51.347986 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=74 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:51.354678 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.355151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.356151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.356598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.381703 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d2a459e6-27b9-4bdf-bd48-c34790480d44 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/ips" status: 200 len: 150 microversion: 2.1 time: 0.043288 Jun 24 10:24:51.382253 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 416/833] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:24:51 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:51.391606 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:51.392399 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=11,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:24:51.396729 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "213b47f9-567f-492e-b0d9-2b86a26ff9d6"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:51.397850 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:51.406115 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.406552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.407333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.407758 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.489847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Invalid volume: volume 213b47f9-567f-492e-b0d9-2b86a26ff9d6 is already attached to instances: 725b1a67-bbbe-48c8-8838-a7b65cedf8da Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: POST /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/os-volume_attachments HTTP/1.1 Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 74 Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:24:51.491594 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {"volumeAttachment": {"volumeId": "213b47f9-567f-492e-b0d9-2b86a26ff9d6"}} Jun 24 10:24:51.493235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Invalid volume: volume 213b47f9-567f-492e-b0d9-2b86a26ff9d6 is already attached to instances: 725b1a67-bbbe-48c8-8838-a7b65cedf8da Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'server_id': '847c5da0-048e-4f9e-bf9b-05be65fafd89', 'body': {'volumeAttachment': {'volumeId': '213b47f9-567f-492e-b0d9-2b86a26ff9d6'}}} Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 213b47f9-567f-492e-b0d9-2b86a26ff9d6 is already attached to instances: 725b1a67-bbbe-48c8-8838-a7b65cedf8da Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:24:51.494111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 213b47f9-567f-492e-b0d9-2b86a26ff9d6 is already attached to instances: 725b1a67-bbbe-48c8-8838-a7b65cedf8da Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:51.495457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 213b47f9-567f-492e-b0d9-2b86a26ff9d6 is already attached to instances: 725b1a67-bbbe-48c8-8838-a7b65cedf8da Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 400 to user: Invalid volume: volume 213b47f9-567f-492e-b0d9-2b86a26ff9d6 is already attached to instances: 725b1a67-bbbe-48c8-8838-a7b65cedf8da {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6bd043f0-d9fe-4f88-8983-7c1695e05a8b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102881 Jun 24 10:24:51.496806 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 418/834] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:24:51 2022] POST /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89/os-volume_attachments => generated 174 bytes in 104 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:24:51.502327 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:51.502854 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:51.509046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.509500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.510264 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.510693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.536800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:24:51.617670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-42c8c724-f6ae-4e0c-a4b9-54aaa6a907ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 204 len: 0 microversion: 2.1 time: 0.119017 Jun 24 10:24:51.618284 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 417/835] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:24:51 2022] DELETE /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:24:51.627913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:51.628794 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:51.638414 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.638893 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.639654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:51.640086 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:51.792618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:51.801203 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c214ccf1-1b44-4d22-9a54-6768913bb823 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1681 microversion: 2.1 time: 0.177782 Jun 24 10:24:51.801749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 419/836] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:51 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1681 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:24:52.822063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:52.823016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:52.831984 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:52.832584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:52.833592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:52.834169 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:52.983748 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:52.996638 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c895cdee-ff01-4dc7-892f-4914ab19ac76 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1681 microversion: 2.1 time: 0.180076 Jun 24 10:24:52.997356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 418/837] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:52 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:54.018107 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:54.019126 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:54.029514 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:54.029961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:54.030746 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:54.031182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:54.179229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:54.187267 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e393332c-eedf-4656-859e-83eba2adfc7f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1681 microversion: 2.1 time: 0.176063 Jun 24 10:24:54.187831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 420/838] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:54 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1681 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:55.206173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:55.206815 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:55.214920 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:55.215359 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:55.216309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:55.216925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:55.349474 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:55.357917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4852d2a8-9f94-47b4-849e-f6b5b7485ef0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1681 microversion: 2.1 time: 0.157197 Jun 24 10:24:55.358602 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 419/839] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:55 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:55.660793 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-77036c39-9350-453a-aae1-cb20c2dd6c71 req-1d32f072-6c87-4a82-a898-520b23c264e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "847c5da0-048e-4f9e-bf9b-05be65fafd89", "name": "network-vif-deleted", "tag": "c60c2889-7aaf-4585-97c7-7d769ea738cf"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:24:55.671394 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-77036c39-9350-453a-aae1-cb20c2dd6c71 req-1d32f072-6c87-4a82-a898-520b23c264e7 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:55.672279 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-77036c39-9350-453a-aae1-cb20c2dd6c71 req-1d32f072-6c87-4a82-a898-520b23c264e7 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:55.684441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-77036c39-9350-453a-aae1-cb20c2dd6c71 req-1d32f072-6c87-4a82-a898-520b23c264e7 service nova] Creating event network-vif-deleted:c60c2889-7aaf-4585-97c7-7d769ea738cf for instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 on hv-cinder-84713 Jun 24 10:24:55.690526 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-77036c39-9350-453a-aae1-cb20c2dd6c71 req-1d32f072-6c87-4a82-a898-520b23c264e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033514 Jun 24 10:24:55.691491 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 421/840] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:24:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:24:56.375013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:56.375653 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:56.383005 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:56.383461 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:56.384249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:56.384686 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:56.451870 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:56.459635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-824dad84-be88-4691-8510-bc7921dda7cc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1326 microversion: 2.1 time: 0.088832 Jun 24 10:24:56.460562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 420/841] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:56 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:57.482470 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:57.483108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:57.490236 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:57.490687 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:57.491484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:57.491923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:57.563919 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:24:57.571780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d9b005b0-ae75-468e-90c7-b7d641d20eb3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 200 len: 1326 microversion: 2.1 time: 0.096658 Jun 24 10:24:57.572335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 422/842] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:57 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 1326 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:24:58.591228 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:58.591969 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:58.599385 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:58.599834 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:58.600608 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:58.601042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:58.616231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 HTTP/1.1 Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:24:58.617795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:24:58.619429 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '847c5da0-048e-4f9e-bf9b-05be65fafd89'} Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:24:58.620290 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:24:58.621567 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:24:58.622774 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:24:58.622774 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-78188cc4-ac3d-4b66-b0c9-0c705e17eba1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 404 len: 111 microversion: 2.1 time: 0.033346 Jun 24 10:24:58.622774 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 421/843] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:24:58 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:24:58.628796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-81dcffa7-2a9c-45ad-b5ec-f7f0dc02b05b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '.version_select at 0x7f3774989ca0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:58.650231 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-81dcffa7-2a9c-45ad-b5ec-f7f0dc02b05b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-517919722" status: 202 len: 0 microversion: 2.1 time: 0.025892 Jun 24 10:24:58.650826 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 423/844] 10.222.0.64 () {58 vars in 1217 bytes} [Fri Jun 24 10:24:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-517919722 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:24:59.352479 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:59.352970 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:59.359277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:59.359728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:59.360477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:59.360909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:59.450096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lazy-loading 'services' on Instance uuid 725b1a67-bbbe-48c8-8838-a7b65cedf8da {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:24:59.532370 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e730e619-510d-4a50-afe4-e2bfabc233ca tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments/213b47f9-567f-492e-b0d9-2b86a26ff9d6" status: 202 len: 0 microversion: 2.1 time: 0.183761 Jun 24 10:24:59.533137 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 422/845] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:24:59 2022] DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments/213b47f9-567f-492e-b0d9-2b86a26ff9d6 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:24:59.541702 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:24:59.542918 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:24:59.551183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:59.551640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:59.552479 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:24:59.552960 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:24:59.590084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-260af0db-25e0-4f84-8c3b-d30bc616f314 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052406 Jun 24 10:24:59.590635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 424/846] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:24:59 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:00.613628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:00.614563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:00.621523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:00.621971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:00.622738 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:00.623211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:00.652740 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0e7ac816-782b-450d-8a76-e84bc618a4e9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044510 Jun 24 10:25:00.653278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 423/847] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:25:00 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:25:00.710291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:00.710291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:00.720680 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:00.721129 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:00.721894 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:00.722330 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:00.747261 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:25:00.838875 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d971d6cc-d3da-4031-8131-2a04623206ef tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 204 len: 0 microversion: 2.1 time: 0.132510 Jun 24 10:25:00.839570 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 425/848] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:25:00 2022] DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:25:00.848346 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:00.849034 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:00.855439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:00.855892 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:00.856656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:00.857129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:00.995706 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:01.003928 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4f3bc90e-9572-4f98-806e-8c2ffd8c289e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1680 microversion: 2.1 time: 0.159729 Jun 24 10:25:01.004500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 424/849] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:00 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1680 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:02.025419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:02.026315 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:02.037221 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:02.037910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:02.039148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:02.039780 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:02.166809 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:02.167417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:02.174804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:02.175256 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:02.176041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:02.176483 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:02.265492 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lazy-loading 'services' on Instance uuid f0a59419-920a-4901-8bb2-b952e741184d {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:25:02.347957 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8d7a4631-f5d1-4782-b4a4-0cf91859c50c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d/os-volume_attachments/71b7ff67-dfd3-4abd-b25a-e50cd45e1e5d" status: 202 len: 0 microversion: 2.1 time: 0.184937 Jun 24 10:25:02.348647 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 425/850] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:25:02 2022] DELETE /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d/os-volume_attachments/71b7ff67-dfd3-4abd-b25a-e50cd45e1e5d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:25:02.427185 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:02.435300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a19560ff-e7c8-4ff8-8649-1fb4f69f8bf0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1680 microversion: 2.1 time: 0.416720 Jun 24 10:25:02.436604 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 426/851] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:02 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1680 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:03.455771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:03.456488 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:03.465536 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.466300 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.467369 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.468002 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.471132 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:03.472516 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:03.480607 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.481752 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.482815 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.483550 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.516961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:25:03.561198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:03.575420 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c2127dc7-2d6c-40fb-b0d6-99b9cdaebac5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1612 microversion: 2.1 time: 0.125661 Jun 24 10:25:03.586955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 426/852] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:03 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1612 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:03.645995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2239ac37-a1e2-4136-87a6-36a44a0f8f80 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "DELETE /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 204 len: 0 microversion: 2.1 time: 0.180742 Jun 24 10:25:03.649090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 427/853] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:25:03 2022] DELETE /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:25:03.658227 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:03.659894 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:03.667925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.668394 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.669625 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.670083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.821660 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:03.825345 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-aabc47a4-b3f5-490d-aefc-e92029127c22 req-9dec4618-c592-463a-9b80-5f0113c5c04c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725b1a67-bbbe-48c8-8838-a7b65cedf8da", "name": "network-vif-deleted", "tag": "80524936-44ce-4c42-b54e-f60f40be9414"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:03.829813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-52118f00-62e9-4f13-bfc1-90530ea9ec5b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1514 microversion: 2.1 time: 0.176573 Jun 24 10:25:03.830671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 427/854] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:03 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1514 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:03.833964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-aabc47a4-b3f5-490d-aefc-e92029127c22 req-9dec4618-c592-463a-9b80-5f0113c5c04c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:03.834407 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-aabc47a4-b3f5-490d-aefc-e92029127c22 req-9dec4618-c592-463a-9b80-5f0113c5c04c service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:03.846189 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-aabc47a4-b3f5-490d-aefc-e92029127c22 req-9dec4618-c592-463a-9b80-5f0113c5c04c service nova] Creating event network-vif-deleted:80524936-44ce-4c42-b54e-f60f40be9414 for instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da on hv-cinder-84713 Jun 24 10:25:03.851649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-aabc47a4-b3f5-490d-aefc-e92029127c22 req-9dec4618-c592-463a-9b80-5f0113c5c04c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030300 Jun 24 10:25:03.852340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 428/855] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:25:04.594380 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:04.594982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:04.602617 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:04.603100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:04.603855 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:04.604286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:04.667868 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:04.676262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c2e94b7b-5c8d-42f3-b1f9-54883bfdb36a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 200 len: 1612 microversion: 2.1 time: 0.085952 Jun 24 10:25:04.676820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 428/856] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:04 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 1612 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:04.849548 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:04.850144 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:04.857370 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:04.857815 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:04.858643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:04.859070 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:05.011640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:05.019598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-1bc19243-7e2a-4e6f-9831-d8c03b9ae843 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1514 microversion: 2.1 time: 0.174953 Jun 24 10:25:05.020182 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 429/857] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:04 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1514 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:05.693724 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:05.694897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:05.702249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:05.702691 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:05.703502 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:05.703943 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:05.719302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da HTTP/1.1 Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:25:05.720967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:25:05.722980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '725b1a67-bbbe-48c8-8838-a7b65cedf8da'} Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:25:05.723917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:25:05.725489 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:25:05.726889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:25:05.726889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e7ff4205-1d31-4386-b297-19c5100ea754 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 404 len: 111 microversion: 2.1 time: 0.032874 Jun 24 10:25:05.726889 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 429/858] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:05 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:25:05.731692 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8fe11dfb-71db-4ee3-80f6-7bb13849e9c8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '.version_select at 0x7f3774a00e50>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:05.752108 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8fe11dfb-71db-4ee3-80f6-7bb13849e9c8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-446265766" status: 202 len: 0 microversion: 2.1 time: 0.024157 Jun 24 10:25:05.753386 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 430/859] 10.222.0.64 () {58 vars in 1217 bytes} [Fri Jun 24 10:25:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-446265766 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:25:05.870249 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-8e12d071-e8ff-491d-96aa-40c3a4f39e68 req-9ecd5561-73d5-4034-9f2c-a79f621e248f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f0a59419-920a-4901-8bb2-b952e741184d", "name": "network-vif-deleted", "tag": "37903b9c-fde3-4bdb-ae8f-cbbbad5bee55"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:05.879957 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-8e12d071-e8ff-491d-96aa-40c3a4f39e68 req-9ecd5561-73d5-4034-9f2c-a79f621e248f service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:05.880424 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-8e12d071-e8ff-491d-96aa-40c3a4f39e68 req-9ecd5561-73d5-4034-9f2c-a79f621e248f service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:05.892492 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-8e12d071-e8ff-491d-96aa-40c3a4f39e68 req-9ecd5561-73d5-4034-9f2c-a79f621e248f service nova] Creating event network-vif-deleted:37903b9c-fde3-4bdb-ae8f-cbbbad5bee55 for instance f0a59419-920a-4901-8bb2-b952e741184d on hv-cinder-84713 Jun 24 10:25:05.903634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-8e12d071-e8ff-491d-96aa-40c3a4f39e68 req-9ecd5561-73d5-4034-9f2c-a79f621e248f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038774 Jun 24 10:25:05.904272 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 430/860] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:06.038199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:06.039076 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:06.060955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:06.060955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:06.060955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:06.060955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:06.103570 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:06.105183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:06.105851 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lazy-loading 'fault' on Instance uuid f0a59419-920a-4901-8bb2-b952e741184d {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:25:06.157452 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:06.164350 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b7762770-e6bf-4bab-b856-1f17b2e0c5a3 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 200 len: 1309 microversion: 2.1 time: 0.130959 Jun 24 10:25:06.165173 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 431/861] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:06 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:06.506840 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-396e8d79-7125-440a-8d2e-c0ed96b06bc4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: .version_select at 0x7f37749b5790>, body: {"keypair": {"name": "tempest-keypair-936333137", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+Wg6pgolx3KXsWMsahMG3lK9gTwAj02o7CeZEEwj8cBrhRWUCyYQIIEwr2fyj/UuJ3QLwhc1ZZD//k7X5qMSYJIbof/BfFdq9Uq+oaSNqZ2V487AMP0axjvOmn3Zr25g=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:06.521117 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-396e8d79-7125-440a-8d2e-c0ed96b06bc4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:25:06.525071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-396e8d79-7125-440a-8d2e-c0ed96b06bc4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:25:06.547507 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-396e8d79-7125-440a-8d2e-c0ed96b06bc4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045040 Jun 24 10:25:06.548261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 431/862] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:25:06 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:07.182172 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:07.182895 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: f0a59419-920a-4901-8bb2-b952e741184d] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:07.189554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:07.190992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:07.191769 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:07.192224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:07.205658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] HTTP exception thrown: Instance f0a59419-920a-4901-8bb2-b952e741184d could not be found. Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Request method failure captured: Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d HTTP/1.1 Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZDMLyDOWKEHvBg9Qs1mnRDJQh3AyxbADAhGOBXZVZ3nh7wLIPgtZLQHjrzJxlLHyYm2DgdZ1gvyc4cS85jUuQ4jCTegJESCNP_RdKx0gBAuKpYb2f56LnwG4Ln4pVaeYdROx3dUKOzKxOSB5yq_Lj7ebMLDPYlJW5oK-VL6WQ9Oimk Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 5ea13d1f279d466e9a359c02548494b4 Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1331631483 Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:25:07.208030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5ea13d1f279d466e9a359c02548494b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5ea13d1f279d466e9a359c02548494b4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ea13d1f279d466e9a359c02548494b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ea13d1f279d466e9a359c02548494b4"}]}] Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesSnapshotTestJSON-1331631483 Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 5ea13d1f279d466e9a359c02548494b4 Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1331631483 Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesSnapshotTestJSON-1331631483-project Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 5ba18b0e8ba74364a104582d296334c6 Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesSnapshotTestJSON-1331631483-project Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance f0a59419-920a-4901-8bb2-b952e741184d could not be found. Jun 24 10:25:07.209716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'f0a59419-920a-4901-8bb2-b952e741184d'} Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f0a59419-920a-4901-8bb2-b952e741184d could not be found. Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:25:07.210932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f0a59419-920a-4901-8bb2-b952e741184d could not be found. Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f0a59419-920a-4901-8bb2-b952e741184d could not be found. Jun 24 10:25:07.212785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:07.214020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Returning 404 to user: Instance f0a59419-920a-4901-8bb2-b952e741184d could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:25:07.214020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-a81fe9ff-1fd7-41ed-93bf-847f939af8e1 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d" status: 404 len: 111 microversion: 2.1 time: 0.031363 Jun 24 10:25:07.214020 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 432/863] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:07 2022] GET /compute/v2.1/servers/f0a59419-920a-4901-8bb2-b952e741184d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:25:07.883514 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1776818711", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62d2509b-2c7f-4b5f-9593-650742984d82"}], "security_groups": [{"name": "tempest-securitygroup--24698560"}], "key_name": "tempest-keypair-936333137", "user_data": "}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:08.000496 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] validate_networks() for [('62d2509b-2c7f-4b5f-9593-650742984d82', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:25:08.401713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:25:08.402190 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:25:08.402698 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:25:08.403158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:25:08.403566 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:25:08.413237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:08.413630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:08.414422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:08.414897 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:08.431779 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:25:08.435707 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:25:08.447539 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:25:08.449935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:25:08.497208 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-da6fc3be-8520-4103-87e9-12a9ca315b8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.618261 Jun 24 10:25:08.497849 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 432/864] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:25:07 2022] POST /compute/v2.1/servers => generated 400 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:25:08.508376 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-509ee246-1208-4f17-bb05-a4cca61bf08a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:08.508939 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-509ee246-1208-4f17-bb05-a4cca61bf08a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:08.565525 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-509ee246-1208-4f17-bb05-a4cca61bf08a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:08.572457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-509ee246-1208-4f17-bb05-a4cca61bf08a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1241 microversion: 2.1 time: 0.067930 Jun 24 10:25:08.573047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 433/865] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:08 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:09.591802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:09.592417 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:09.599668 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:09.600125 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:09.601262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:09.601431 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:09.620385 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:09.665667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:09.673753 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6f575521-35b9-44d7-ae42-83da19832af8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1245 microversion: 2.1 time: 0.086488 Jun 24 10:25:09.674322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 433/866] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:09 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:10.691191 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:10.692532 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:10.700904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:10.701358 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:10.702141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:10.702927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:10.771170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:10.779429 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-487d3155-0495-4985-8ded-9f900ee212c1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1299 microversion: 2.1 time: 0.092382 Jun 24 10:25:10.779999 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 434/867] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:10 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:11.796720 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:11.799394 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:11.806022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:11.806866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:11.807806 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:11.808407 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:11.986104 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:11.995439 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-30c01d86-0bb2-4e48-9fa1-a14ce63c92b3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.202543 Jun 24 10:25:12.004866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 434/868] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:11 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:12.093689 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-b4434003-712f-4a9d-8286-235ac03531ab req-505348ec-fd57-43e7-9e75-59f69664925f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f", "tag": "73f96876-3a38-4147-b0fd-ba55303f2406"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:12.105989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b4434003-712f-4a9d-8286-235ac03531ab req-505348ec-fd57-43e7-9e75-59f69664925f service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:12.119815 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-b4434003-712f-4a9d-8286-235ac03531ab req-505348ec-fd57-43e7-9e75-59f69664925f service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:12.132779 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-b4434003-712f-4a9d-8286-235ac03531ab req-505348ec-fd57-43e7-9e75-59f69664925f service nova] Creating event network-changed:73f96876-3a38-4147-b0fd-ba55303f2406 for instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f on hv-cinder-84713 Jun 24 10:25:12.137985 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-b4434003-712f-4a9d-8286-235ac03531ab req-505348ec-fd57-43e7-9e75-59f69664925f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050322 Jun 24 10:25:12.138605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 435/869] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:13.014639 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:13.015590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:13.024848 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:13.025316 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:13.026070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:13.026511 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:13.158367 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:13.166632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-77b4b83c-b82a-4e94-b2b4-b7a491ca0943 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.157577 Jun 24 10:25:13.167215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 435/870] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:13 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:14.192796 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:14.193932 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:14.201931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:14.202374 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:14.203165 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:14.203589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:14.222218 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:14.347402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:14.356474 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8cb4b045-8ba4-4977-92da-a38efd19c890 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.170986 Jun 24 10:25:14.357041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 436/871] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:14 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:15.096618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-890260726", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "networks": [{"uuid": "403c5ff5-8a5f-4962-8aef-dabb2ed88792"}]}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:15.153006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] validate_networks() for [('403c5ff5-8a5f-4962-8aef-dabb2ed88792', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:25:15.373916 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:15.374538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:15.381475 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:15.381913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:15.383251 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:15.383846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:15.570647 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:25:15.571163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:25:15.571670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:25:15.572075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:25:15.572507 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:25:15.581819 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:15.582229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:15.582403 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:15.583070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:15.583494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:15.590196 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c7ce7191-88cf-4816-a766-8f682027276a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.220207 Jun 24 10:25:15.590903 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 437/872] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:15 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:15.601110 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Getting quotas for project 5ea13d1f279d466e9a359c02548494b4. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:25:15.605209 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Getting quotas for user 5ba18b0e8ba74364a104582d296334c6 and project 5ea13d1f279d466e9a359c02548494b4. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:25:15.617299 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:25:15.619493 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:25:15.667041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-91b8bdeb-2963-474d-9f37-0af771f4a683 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.576693 Jun 24 10:25:15.668022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 436/873] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:25:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:25:15.678401 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8f2fa7b0-cb10-402e-a276-6b9a644db739 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:15.679120 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8f2fa7b0-cb10-402e-a276-6b9a644db739 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:15.750160 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8f2fa7b0-cb10-402e-a276-6b9a644db739 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:15.757076 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8f2fa7b0-cb10-402e-a276-6b9a644db739 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1218 microversion: 2.1 time: 0.082514 Jun 24 10:25:15.757781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 438/874] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:15 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:16.608718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:16.609314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:16.617276 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:16.617276 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:16.618113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:16.619289 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:16.778409 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:16.781656 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:16.782097 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:16.795016 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3e347a76-067b-483d-a7db-b39c4be9fa82 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.190836 Jun 24 10:25:16.797241 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:16.798085 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:16.798876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:16.799357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:16.807112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 437/875] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:16 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:16.871706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:16.879716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b8393171-1346-4908-946a-b1624a27983a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1278 microversion: 2.1 time: 0.108628 Jun 24 10:25:16.886857 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 439/876] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:16 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1278 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:17.813548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:17.814797 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:17.821744 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:17.822466 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:17.823273 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:17.823713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:17.900739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:17.902589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:17.911955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:17.912737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:17.913749 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:17.914465 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:18.044680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:18.052533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a77fa7f3-fdc1-4198-aeb7-642d1497293c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.242839 Jun 24 10:25:18.053099 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 438/877] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:17 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:18.092488 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-dccd5456-ca62-427e-bbdd-f8de499f6be5 req-c4280299-e1dd-4b27-a574-81d833edbec8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61b7c293-c38d-4119-ae19-3f9e1681f49c", "tag": "73f33625-e9bd-45dd-b6cc-b25f1b9660d1"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:18.102964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-dccd5456-ca62-427e-bbdd-f8de499f6be5 req-c4280299-e1dd-4b27-a574-81d833edbec8 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:18.103336 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-dccd5456-ca62-427e-bbdd-f8de499f6be5 req-c4280299-e1dd-4b27-a574-81d833edbec8 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:18.118440 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-dccd5456-ca62-427e-bbdd-f8de499f6be5 req-c4280299-e1dd-4b27-a574-81d833edbec8 service nova] Creating event network-changed:73f33625-e9bd-45dd-b6cc-b25f1b9660d1 for instance 61b7c293-c38d-4119-ae19-3f9e1681f49c on hv-cinder-84713 Jun 24 10:25:18.123723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-dccd5456-ca62-427e-bbdd-f8de499f6be5 req-c4280299-e1dd-4b27-a574-81d833edbec8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035049 Jun 24 10:25:18.124348 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 439/878] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:25:18.129818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:18.137898 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8c8d3c40-721e-4782-89e1-89c84b9416bb tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1318 microversion: 2.1 time: 0.243426 Jun 24 10:25:18.138558 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 440/879] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:17 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1318 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:25:19.076562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:19.077590 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:19.088809 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:19.089264 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:19.090037 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:19.090480 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:19.155504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:19.156089 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:19.162906 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:19.163359 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:19.165522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:19.165522 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:19.283034 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:19.291464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-42866c5a-2e1b-439a-9087-f32fa398dda4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.224035 Jun 24 10:25:19.292028 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 440/880] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:19 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:19.334428 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:19.343111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e51cf952-4dd3-463a-a399-fe2abf796288 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1318 microversion: 2.1 time: 0.191412 Jun 24 10:25:19.343797 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 441/881] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:19 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:25:19.776163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-c98fba96-537e-4ac5-9820-d15fd3f822d5 req-3e6aa751-2685-49f4-a767-72cb2ac39502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f", "name": "network-vif-plugged", "status": "completed", "tag": "73f96876-3a38-4147-b0fd-ba55303f2406"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:19.785482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-c98fba96-537e-4ac5-9820-d15fd3f822d5 req-3e6aa751-2685-49f4-a767-72cb2ac39502 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:19.786291 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-c98fba96-537e-4ac5-9820-d15fd3f822d5 req-3e6aa751-2685-49f4-a767-72cb2ac39502 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:19.798157 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-c98fba96-537e-4ac5-9820-d15fd3f822d5 req-3e6aa751-2685-49f4-a767-72cb2ac39502 service nova] Creating event network-vif-plugged:73f96876-3a38-4147-b0fd-ba55303f2406 for instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f on hv-cinder-84713 Jun 24 10:25:19.804709 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-c98fba96-537e-4ac5-9820-d15fd3f822d5 req-3e6aa751-2685-49f4-a767-72cb2ac39502 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033145 Jun 24 10:25:19.805364 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 441/882] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:20.313186 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:20.314074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:20.324378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:20.324827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:20.325579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:20.326024 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:20.364108 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:20.365168 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:20.369242 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=7 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:20.373564 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:20.374006 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:20.374800 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:20.375231 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:20.508551 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:20.516406 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fcc205e1-d70a-4243-a63d-a4ca7937276d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1365 microversion: 2.1 time: 0.209883 Jun 24 10:25:20.516980 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 442/883] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:20 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1365 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:20.544148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:20.551843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0048dadd-0624-4d6e-88ec-d572fff814bc tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1318 microversion: 2.1 time: 0.195018 Jun 24 10:25:20.552384 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 442/884] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:20 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1318 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:21.537923 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:21.538900 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:21.542177 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=2,nova_api:UPDATE=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:21.548604 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:21.549093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:21.549843 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:21.550280 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:21.569045 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:21.569597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:21.576632 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:21.577088 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:21.577862 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:21.578298 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:21.751931 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:21.756437 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:21.760880 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-9222a4fb-4cd8-496e-8948-35fe105daa0d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1555 microversion: 2.1 time: 0.229804 Jun 24 10:25:21.761700 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 443/885] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:21 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1555 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:21.765312 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-41d95f28-918e-4d74-ba54-e7f0bad3a20c tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1318 microversion: 2.1 time: 0.200235 Jun 24 10:25:21.765849 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 443/886] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:21 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:21.777649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:21.778146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:21.784320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:21.784772 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:21.785539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:21.785978 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:21.864983 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-637c7e5c-4f1a-4541-b78a-f0aad12c0f3e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091173 Jun 24 10:25:21.865578 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 444/887] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:25:21 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:22.781490 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:22.782109 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:22.788958 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:22.789630 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:22.792565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:22.793245 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:22.820598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-eb09ac5a-72b0-428a-8742-5ba8226034de req-1f80e3a7-6f2a-46a6-b7e0-f19c8d41e333 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f", "tag": "73f96876-3a38-4147-b0fd-ba55303f2406"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:22.829153 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-eb09ac5a-72b0-428a-8742-5ba8226034de req-1f80e3a7-6f2a-46a6-b7e0-f19c8d41e333 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:22.829602 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-eb09ac5a-72b0-428a-8742-5ba8226034de req-1f80e3a7-6f2a-46a6-b7e0-f19c8d41e333 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:22.844718 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-eb09ac5a-72b0-428a-8742-5ba8226034de req-1f80e3a7-6f2a-46a6-b7e0-f19c8d41e333 service nova] Creating event network-changed:73f96876-3a38-4147-b0fd-ba55303f2406 for instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f on hv-cinder-84713 Jun 24 10:25:22.849938 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-eb09ac5a-72b0-428a-8742-5ba8226034de req-1f80e3a7-6f2a-46a6-b7e0-f19c8d41e333 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033545 Jun 24 10:25:22.850506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 445/888] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:25:22.935803 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:22.944041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9adc220a-d000-42a9-9284-45a0760a1d86 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1318 microversion: 2.1 time: 0.166402 Jun 24 10:25:22.944618 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 444/889] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:22 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:23.803827 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-db831392-1076-4ceb-bfd6-e9b617015ff1 req-586eff80-6ab9-48b6-926d-5a8a9159a0f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b7c293-c38d-4119-ae19-3f9e1681f49c", "name": "network-vif-plugged", "status": "completed", "tag": "73f33625-e9bd-45dd-b6cc-b25f1b9660d1"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:23.813335 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-db831392-1076-4ceb-bfd6-e9b617015ff1 req-586eff80-6ab9-48b6-926d-5a8a9159a0f8 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:23.813813 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-db831392-1076-4ceb-bfd6-e9b617015ff1 req-586eff80-6ab9-48b6-926d-5a8a9159a0f8 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:23.825634 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-db831392-1076-4ceb-bfd6-e9b617015ff1 req-586eff80-6ab9-48b6-926d-5a8a9159a0f8 service nova] Creating event network-vif-plugged:73f33625-e9bd-45dd-b6cc-b25f1b9660d1 for instance 61b7c293-c38d-4119-ae19-3f9e1681f49c on hv-cinder-84713 Jun 24 10:25:23.830502 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-db831392-1076-4ceb-bfd6-e9b617015ff1 req-586eff80-6ab9-48b6-926d-5a8a9159a0f8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030811 Jun 24 10:25:23.831436 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 446/890] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:23.963091 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:23.963710 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:23.970563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:23.971044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:23.971813 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:23.972250 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:24.114737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:24.124038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-70721686-bcc9-4be9-b8cf-9a37f0f14eae tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1318 microversion: 2.1 time: 0.166422 Jun 24 10:25:24.124619 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 445/891] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:23 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:25.143068 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:25.143988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:25.153685 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:25.154136 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:25.154952 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:25.155389 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:25.299243 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:25.307355 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ed320426-fa77-40c7-b3ef-db0d922d493a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1507 microversion: 2.1 time: 0.168484 Jun 24 10:25:25.307921 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 447/892] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:25 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1507 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:25.326198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5cfb17ca-9702-4368-8c78-703111c10c9f", "device": "/dev/sdb"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:25.327839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:25.335796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:25.336886 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:25.337872 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:25.338311 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:25.591755 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=4 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:25.612070 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=16 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:25.618815 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-565e8b64-5a63-4c97-8597-1162d39a5e5a tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "POST /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.298518 Jun 24 10:25:25.619500 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 446/893] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:25:25 2022] POST /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:42.959529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:42.960106 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:42.962399 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=4 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:42.963783 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=9 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:42.964402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=52 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:42.970202 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:42.970665 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:42.971503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:42.971961 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:43.055106 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lazy-loading 'services' on Instance uuid 61b7c293-c38d-4119-ae19-3f9e1681f49c {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:25:43.134526 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c74ab132-94c2-4f4d-ab97-ef1a224b2aef tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "DELETE /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c/os-volume_attachments/5cfb17ca-9702-4368-8c78-703111c10c9f" status: 202 len: 0 microversion: 2.1 time: 0.178956 Jun 24 10:25:43.135190 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 448/894] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:25:42 2022] DELETE /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c/os-volume_attachments/5cfb17ca-9702-4368-8c78-703111c10c9f => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:25:44.267287 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=8 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:44.268198 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:44.274559 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:44.275549 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:44.286013 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:44.287075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:44.287860 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:44.288317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:44.316403 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:25:44.398731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e32cd110-a0d0-45c3-bed2-05d5111c7720 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "DELETE /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 204 len: 0 microversion: 2.1 time: 0.134070 Jun 24 10:25:44.399563 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 447/895] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:25:44 2022] DELETE /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:25:44.412208 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:44.413096 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:44.419364 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:44.419813 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:44.420587 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:44.421090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:44.556218 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:44.563973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0bb68a46-a457-4749-a03e-9f62283a7a0f tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1513 microversion: 2.1 time: 0.158379 Jun 24 10:25:44.564534 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 449/896] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:44 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:45.582914 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:45.583594 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:45.590917 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:45.591375 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:45.592151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:45.592587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:45.731104 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:45.738890 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-31b4ff6b-d763-4ac5-abb5-744a47d37fb5 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1513 microversion: 2.1 time: 0.160420 Jun 24 10:25:45.739487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 448/897] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:45 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:46.594030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-c9f1740f-b4a0-4984-a663-dd4ff06a66d3 req-895bf86f-3090-4958-b8c6-892d42820a45 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61b7c293-c38d-4119-ae19-3f9e1681f49c", "name": "network-vif-deleted", "tag": "73f33625-e9bd-45dd-b6cc-b25f1b9660d1"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:25:46.604635 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-c9f1740f-b4a0-4984-a663-dd4ff06a66d3 req-895bf86f-3090-4958-b8c6-892d42820a45 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:46.605084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-c9f1740f-b4a0-4984-a663-dd4ff06a66d3 req-895bf86f-3090-4958-b8c6-892d42820a45 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:46.617209 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-c9f1740f-b4a0-4984-a663-dd4ff06a66d3 req-895bf86f-3090-4958-b8c6-892d42820a45 service nova] Creating event network-vif-deleted:73f33625-e9bd-45dd-b6cc-b25f1b9660d1 for instance 61b7c293-c38d-4119-ae19-3f9e1681f49c on hv-cinder-84713 Jun 24 10:25:46.623145 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-c9f1740f-b4a0-4984-a663-dd4ff06a66d3 req-895bf86f-3090-4958-b8c6-892d42820a45 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Jun 24 10:25:46.623768 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 450/898] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:25:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:25:46.756148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:46.756754 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:46.763814 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:46.764298 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:46.765074 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:46.765514 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:46.797768 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:46.798219 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:46.798673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lazy-loading 'fault' on Instance uuid 61b7c293-c38d-4119-ae19-3f9e1681f49c {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:25:46.842745 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5ba18b0e8ba74364a104582d296334c6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5ea13d1f279d466e9a359c02548494b4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:25:46.850737 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7928766c-6c38-47df-ad03-2513de160558 tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 200 len: 1308 microversion: 2.1 time: 0.098614 Jun 24 10:25:46.851321 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 449/899] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:46 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:25:47.870275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:47.870966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] [instance: 61b7c293-c38d-4119-ae19-3f9e1681f49c] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:47.877733 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:47.878192 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:47.878995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:47.879410 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:47.893308 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] HTTP exception thrown: Instance 61b7c293-c38d-4119-ae19-3f9e1681f49c could not be found. Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Request method failure captured: Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c HTTP/1.1 Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZDMLyDOWKEHvBg9Qs1mnRDJQh3AyxbADAhGOBXZVZ3nh7wLIPgtZLQHjrzJxlLHyYm2DgdZ1gvyc4cS85jUuQ4jCTegJESCNP_RdKx0gBAuKpYb2f56LnwG4Ln4pVaeYdROx3dUKOzKxOSB5yq_Lj7ebMLDPYlJW5oK-VL6WQ9Oimk Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 5ea13d1f279d466e9a359c02548494b4 Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1331631483 Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:25:47.895008 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/5ea13d1f279d466e9a359c02548494b4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_5ea13d1f279d466e9a359c02548494b4", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ea13d1f279d466e9a359c02548494b4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/5ea13d1f279d466e9a359c02548494b4"}]}] Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesSnapshotTestJSON-1331631483 Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 5ea13d1f279d466e9a359c02548494b4 Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1331631483 Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesSnapshotTestJSON-1331631483-project Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 5ba18b0e8ba74364a104582d296334c6 Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesSnapshotTestJSON-1331631483-project Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 61b7c293-c38d-4119-ae19-3f9e1681f49c could not be found. Jun 24 10:25:47.896592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '61b7c293-c38d-4119-ae19-3f9e1681f49c'} Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 61b7c293-c38d-4119-ae19-3f9e1681f49c could not be found. Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:25:47.897396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 61b7c293-c38d-4119-ae19-3f9e1681f49c could not be found. Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 61b7c293-c38d-4119-ae19-3f9e1681f49c could not be found. Jun 24 10:25:47.899022 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:25:47.900556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] Returning 404 to user: Instance 61b7c293-c38d-4119-ae19-3f9e1681f49c could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:25:47.900556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c8b34d47-ed61-48cb-8fab-b201fe87842b tempest-VolumesSnapshotTestJSON-1331631483 tempest-VolumesSnapshotTestJSON-1331631483-project] 10.222.0.64 "GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c" status: 404 len: 111 microversion: 2.1 time: 0.031134 Jun 24 10:25:47.900556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 451/900] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:25:47 2022] GET /compute/v2.1/servers/61b7c293-c38d-4119-ae19-3f9e1681f49c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:25:58.776142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:25:58.776728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:25:58.779325 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:58.779962 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:25:58.785543 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:58.785991 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:58.786785 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:25:58.787221 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:25:58.813568 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b9008391-6d07-489e-98ee-ae74474abac2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/ips" status: 200 len: 150 microversion: 2.1 time: 0.042934 Jun 24 10:25:58.814184 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 450/901] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:25:58 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/ips => generated 150 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:00.136411 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e02633f0-b954-400d-92a2-472a7e5d173b"}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:00.137506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:00.139841 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=8 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:00.140670 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:00.146723 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:00.147178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:00.147949 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:00.148385 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:00.418670 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-31cb741a-1fc3-42e9-8e7a-52f2abe517e0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286375 Jun 24 10:26:00.419351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 452/902] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:26:00 2022] POST /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:06.906160 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e02633f0-b954-400d-92a2-472a7e5d173b"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:06.907326 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:06.916295 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:06.917178 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:06.918086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:06.918535 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:07.012718 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Invalid volume: volume e02633f0-b954-400d-92a2-472a7e5d173b is already attached to instances: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: POST /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments HTTP/1.1 Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 74 Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:26:07.014477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {"volumeAttachment": {"volumeId": "e02633f0-b954-400d-92a2-472a7e5d173b"}} Jun 24 10:26:07.016262 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Invalid volume: volume e02633f0-b954-400d-92a2-472a7e5d173b is already attached to instances: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'server_id': '0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f', 'body': {'volumeAttachment': {'volumeId': 'e02633f0-b954-400d-92a2-472a7e5d173b'}}} Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e02633f0-b954-400d-92a2-472a7e5d173b is already attached to instances: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:07.017215 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e02633f0-b954-400d-92a2-472a7e5d173b is already attached to instances: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:26:07.018676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e02633f0-b954-400d-92a2-472a7e5d173b is already attached to instances: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 400 to user: Invalid volume: volume e02633f0-b954-400d-92a2-472a7e5d173b is already attached to instances: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5fb9735e-0f28-41f0-bad1-cc45ace939a3 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114728 Jun 24 10:26:07.021252 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 451/903] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:26:06 2022] POST /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments => generated 174 bytes in 118 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:26:07.096039 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:07.096670 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:07.106288 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:07.106920 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:07.107814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:07.108318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:07.200171 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lazy-loading 'services' on Instance uuid 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:26:07.287816 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2c039eac-bf19-4e34-b99f-7220fdc9c9f9 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments/e02633f0-b954-400d-92a2-472a7e5d173b" status: 202 len: 0 microversion: 2.1 time: 0.196683 Jun 24 10:26:07.288484 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 453/904] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:26:07 2022] DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments/e02633f0-b954-400d-92a2-472a7e5d173b => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:26:07.298193 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:07.299317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:07.310792 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:07.311267 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:07.312048 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:07.312478 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:07.353405 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1b18e782-517b-431f-b700-07359de92f8e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058690 Jun 24 10:26:07.354027 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 452/905] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:26:07 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:08.369166 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:08.370554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:08.377098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:08.377555 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:08.378378 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:08.378847 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:08.422006 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-6c12ddad-94f9-40b2-9ab2-8b18d83a0fc5 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.059106 Jun 24 10:26:08.422575 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 454/906] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:26:08 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:26:08.483924 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:08.484475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:08.491123 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:08.491575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:08.492356 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:08.492773 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:08.518258 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:26:08.601304 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8a8676bb-a141-4570-b37e-25e4435c6dc8 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 204 len: 0 microversion: 2.1 time: 0.121103 Jun 24 10:26:08.601963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 453/907] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:26:08 2022] DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:26:08.611000 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:08.611615 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:08.617737 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:08.618180 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:08.618967 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:08.619458 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:08.759266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:08.769853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-49f1e7c6-44a4-49ea-9b15-6813df7999ad tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1680 microversion: 2.1 time: 0.162579 Jun 24 10:26:08.770578 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 455/908] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:08 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:26:09.790008 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:09.790727 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:09.798354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:09.798835 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:09.799614 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:09.800051 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:09.938374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:09.947620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7f8f2821-796d-41c8-b10c-ac3013c5161f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1680 microversion: 2.1 time: 0.161929 Jun 24 10:26:09.948648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 454/909] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:09 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:10.966026 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:10.966949 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:10.973873 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:10.974589 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:10.976183 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:10.976975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:11.069240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-a3b6141a-e031-4a95-b57b-824e57813e6d req-871fc09e-4e0f-430e-88c5-32a45765da2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f", "name": "network-vif-deleted", "tag": "73f96876-3a38-4147-b0fd-ba55303f2406"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:11.094095 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-a3b6141a-e031-4a95-b57b-824e57813e6d req-871fc09e-4e0f-430e-88c5-32a45765da2d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:11.094544 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-a3b6141a-e031-4a95-b57b-824e57813e6d req-871fc09e-4e0f-430e-88c5-32a45765da2d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:11.096728 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:11.113913 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-a3b6141a-e031-4a95-b57b-824e57813e6d req-871fc09e-4e0f-430e-88c5-32a45765da2d service nova] Creating event network-vif-deleted:73f96876-3a38-4147-b0fd-ba55303f2406 for instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f on hv-cinder-84713 Jun 24 10:26:11.122022 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-a3b6141a-e031-4a95-b57b-824e57813e6d req-871fc09e-4e0f-430e-88c5-32a45765da2d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060439 Jun 24 10:26:11.124170 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 455/910] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:26:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:11.129674 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8b697530-2510-4256-a141-0b1e84b0915e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 200 len: 1614 microversion: 2.1 time: 0.168031 Jun 24 10:26:11.130395 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 456/911] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:10 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 1614 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:12.148223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:12.148955 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:12.156277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:12.156859 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:12.157481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:12.157918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:12.172113 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f HTTP/1.1 Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:26:12.173713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:26:12.175358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f'} Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:26:12.176310 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:26:12.177869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:26:12.179302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:26:12.179302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ac538f07-14e6-4161-b86f-6ffb54cd407b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 404 len: 111 microversion: 2.1 time: 0.031326 Jun 24 10:26:12.179302 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 456/912] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:12 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:26:12.184357 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d297587e-51fd-4ef3-94a9-bb2f2db6583f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '.version_select at 0x7f3774ac7670>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:12.205552 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d297587e-51fd-4ef3-94a9-bb2f2db6583f tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-936333137" status: 202 len: 0 microversion: 2.1 time: 0.025131 Jun 24 10:26:12.206105 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 457/913] 10.222.0.64 () {58 vars in 1217 bytes} [Fri Jun 24 10:26:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-936333137 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:26:12.859972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-83aab575-ebf7-4f9a-8e1c-0aa6b65c59b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: .version_select at 0x7f3774a2d0d0>, body: {"keypair": {"name": "tempest-keypair-1631175149", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPODifEeXUX2szxXxAxge50hSvzEgU9UMwmVgc9ZJDKQ2D3lbK2aRmeL7gYllL8atqHeGifszIJJ48fH8vEBETj3fVvqNmUMKBZBb3laz7BqdDZBbSZakluUXexh61uEOA=="}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:12.875158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-83aab575-ebf7-4f9a-8e1c-0aa6b65c59b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:26:12.879069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-83aab575-ebf7-4f9a-8e1c-0aa6b65c59b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'key_pairs'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:26:12.903586 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-83aab575-ebf7-4f9a-8e1c-0aa6b65c59b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047606 Jun 24 10:26:12.904168 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 457/914] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:26:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:14.260660 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-779920758", "imageRef": "26e33f1f-1523-4548-ba3c-9b3b1b80f42d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "62d2509b-2c7f-4b5f-9593-650742984d82"}], "security_groups": [{"name": "tempest-securitygroup--2005196393"}], "key_name": "tempest-keypair-1631175149", "user_data": "}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:14.366968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] validate_networks() for [('62d2509b-2c7f-4b5f-9593-650742984d82', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:26:14.758819 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:26:14.759311 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:26:14.759818 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:26:14.760263 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:26:14.760682 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:26:14.770164 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:14.770611 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:14.771454 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:14.771893 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:14.788861 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:26:14.793211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Getting quotas for user f96ee29f9c5b4651825da16d0520a0e8 and project 13b216e0dd4e46e2a2f4b275666118f6. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:26:14.805442 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:26:14.807782 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='26e33f1f-1523-4548-ba3c-9b3b1b80f42d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:26:14.860638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8be0948c-9851-4ee3-96ed-837643485c7c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.604901 Jun 24 10:26:14.861281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 458/915] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:26:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 606 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:26:14.873526 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-1e42e053-2000-4e49-9a93-0a6205512fd0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:14.874243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-1e42e053-2000-4e49-9a93-0a6205512fd0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:14.941598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-1e42e053-2000-4e49-9a93-0a6205512fd0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:14.952519 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-1e42e053-2000-4e49-9a93-0a6205512fd0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1241 microversion: 2.1 time: 0.084556 Jun 24 10:26:14.953481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 458/916] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:14 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:15.974471 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:15.975130 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:15.982498 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:15.982975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:15.983740 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:15.984174 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:16.047914 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:16.055592 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2d521d1a-f1e8-4541-af3d-650e44020dbc tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1245 microversion: 2.1 time: 0.086122 Jun 24 10:26:16.056298 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 459/917] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:15 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1245 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:17.072884 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:17.073887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:17.080467 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:17.080923 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:17.081709 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:17.082141 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:17.146216 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:17.155536 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b01f3e09-1028-4066-81a6-c42bb4418e91 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1299 microversion: 2.1 time: 0.086735 Jun 24 10:26:17.156438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 459/918] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:17 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:18.007940 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-3fdb9506-3c03-4ae4-a3de-ac86f005333e req-70c60dc9-caf8-4e8c-9684-fb0e69d08e53 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e6cd9d-142e-4fc4-a774-3b5f0f974f45", "tag": "c497946e-5912-4677-908c-57e4aa280178"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:18.018061 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-3fdb9506-3c03-4ae4-a3de-ac86f005333e req-70c60dc9-caf8-4e8c-9684-fb0e69d08e53 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:18.018434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-3fdb9506-3c03-4ae4-a3de-ac86f005333e req-70c60dc9-caf8-4e8c-9684-fb0e69d08e53 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:18.030523 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-3fdb9506-3c03-4ae4-a3de-ac86f005333e req-70c60dc9-caf8-4e8c-9684-fb0e69d08e53 service nova] Creating event network-changed:c497946e-5912-4677-908c-57e4aa280178 for instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 on hv-cinder-84713 Jun 24 10:26:18.035375 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-3fdb9506-3c03-4ae4-a3de-ac86f005333e req-70c60dc9-caf8-4e8c-9684-fb0e69d08e53 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031152 Jun 24 10:26:18.036326 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 460/919] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:18.173802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:18.174451 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:18.181690 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:18.182144 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:18.183222 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:18.183670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:18.317882 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:18.325887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-c5acb987-947e-4914-b3f8-d7ac62ea953a tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1367 microversion: 2.1 time: 0.156223 Jun 24 10:26:18.326467 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 460/920] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:18 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:19.343972 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:19.344767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:19.351431 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:19.351878 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:19.352643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:19.353072 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:19.508362 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:19.518683 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-79b74cef-d171-43e6-bf30-0e360eb429f1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1367 microversion: 2.1 time: 0.179593 Jun 24 10:26:19.519344 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 461/921] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:19 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:20.535881 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:20.536538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:20.543385 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:20.543839 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:20.544820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:20.545251 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:20.756271 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:20.764260 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e5c25165-2c80-4ec3-b1ed-1b48407464cb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1367 microversion: 2.1 time: 0.232431 Jun 24 10:26:20.765210 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 461/922] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:20 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:21.781693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:21.782273 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:21.802073 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:21.802821 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:21.804705 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:21.805438 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:22.061867 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:22.071639 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-97ac3e7c-998a-4fa6-bc1e-08aebac33b2e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1367 microversion: 2.1 time: 0.293981 Jun 24 10:26:22.072512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 462/923] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:21 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:22.141033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-752fcc71-fed7-4b0b-bead-1c17bc9ea001 req-3f9325df-f40f-41ce-80f1-a6f21f36d70d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e6cd9d-142e-4fc4-a774-3b5f0f974f45", "name": "network-vif-plugged", "status": "completed", "tag": "c497946e-5912-4677-908c-57e4aa280178"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:22.154279 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-752fcc71-fed7-4b0b-bead-1c17bc9ea001 req-3f9325df-f40f-41ce-80f1-a6f21f36d70d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:22.155080 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-752fcc71-fed7-4b0b-bead-1c17bc9ea001 req-3f9325df-f40f-41ce-80f1-a6f21f36d70d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:22.168268 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-752fcc71-fed7-4b0b-bead-1c17bc9ea001 req-3f9325df-f40f-41ce-80f1-a6f21f36d70d service nova] Creating event network-vif-plugged:c497946e-5912-4677-908c-57e4aa280178 for instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 on hv-cinder-84713 Jun 24 10:26:22.174066 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-752fcc71-fed7-4b0b-bead-1c17bc9ea001 req-3f9325df-f40f-41ce-80f1-a6f21f36d70d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038015 Jun 24 10:26:22.174976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 462/924] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:26:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:23.088671 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:23.089368 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:23.095995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:23.096447 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:23.097213 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:23.097649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:23.340859 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:23.351716 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5e4c0680-fb17-4851-9e1d-d5d7af30818c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1367 microversion: 2.1 time: 0.267039 Jun 24 10:26:23.353293 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 463/925] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:23 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1367 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:24.370669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:24.372233 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:24.380725 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:24.381203 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:24.382087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:24.382669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:24.684087 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:24.691879 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0aa1b85f-4ba2-4716-97d0-7848fc6577a2 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1556 microversion: 2.1 time: 0.325605 Jun 24 10:26:24.692462 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 463/926] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:24 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1556 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:24.708724 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:24.709226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:24.716766 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:24.717217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:24.718001 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:24.718434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:24.780176 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:24.801242 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-c8b55015-8d5b-42a7-b8d6-6d57504da95d tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096632 Jun 24 10:26:24.802042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 464/927] 10.222.0.64 () {58 vars in 1274 bytes} [Fri Jun 24 10:26:24 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:26.086823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-3b62be84-0bc2-4f8e-aa0f-2a08e72c21e5 req-3eb0facc-6090-4de2-b58c-74d67a20a64f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12e6cd9d-142e-4fc4-a774-3b5f0f974f45", "tag": "c497946e-5912-4677-908c-57e4aa280178"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:26.095402 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:26.099071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-3b62be84-0bc2-4f8e-aa0f-2a08e72c21e5 req-3eb0facc-6090-4de2-b58c-74d67a20a64f service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:26.099785 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-3b62be84-0bc2-4f8e-aa0f-2a08e72c21e5 req-3eb0facc-6090-4de2-b58c-74d67a20a64f service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:26.112770 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-3b62be84-0bc2-4f8e-aa0f-2a08e72c21e5 req-3eb0facc-6090-4de2-b58c-74d67a20a64f service nova] Creating event network-changed:c497946e-5912-4677-908c-57e4aa280178 for instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 on hv-cinder-84713 Jun 24 10:26:26.118723 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-3b62be84-0bc2-4f8e-aa0f-2a08e72c21e5 req-3eb0facc-6090-4de2-b58c-74d67a20a64f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035938 Jun 24 10:26:26.120146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 464/928] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:26:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:30.020998 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=6 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:30.201088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e931bc06-41f3-42a8-a06e-b94ea75abba8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Action: 'create', calling method: .version_select at 0x7f3774989ca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-197236867", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI1MN3/CkKu+ukucDGgZqQRMVv2h0Q1cV+X+QFO/SKhSJrbuy67UeYiTwfp+CIAAaf0ASQDOW+x8sHvcT3kJpTxURI9g1A9pnpUsXM0vJSIme+enw91ekF3O3V/oSA5E/w=="}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:30.205178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:30.219084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-e931bc06-41f3-42a8-a06e-b94ea75abba8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for project a1af4242504b4c7fa0903c7c61b02135. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:26:30.223083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-e931bc06-41f3-42a8-a06e-b94ea75abba8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for user 5855c9996e4345aa8f71463648b6009e and project a1af4242504b4c7fa0903c7c61b02135. Resources: {'key_pairs'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:26:30.247556 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e931bc06-41f3-42a8-a06e-b94ea75abba8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.227185 Jun 24 10:26:30.248169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 465/929] 10.222.0.64 () {60 vars in 1158 bytes} [Fri Jun 24 10:26:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:46.640777 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:46.641538 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:46.645732 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1031589991", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-197236867", "security_groups": [{"name": "tempest-secgroup-smoke-511313019"}], "block_device_mapping_v2": [{"uuid": "dd3cdbd3-b9df-487e-801e-3d4b77c0913a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "974e48a5-8005-4f80-8ebd-0fd83f94a22c"}]}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:46.769021 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] validate_networks() for [('974e48a5-8005-4f80-8ebd-0fd83f94a22c', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:26:47.171233 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:26:47.171964 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:26:47.172972 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:26:47.173887 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:26:47.174059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:26:47.188942 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:47.189398 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:47.190206 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:47.190648 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:47.212358 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for project a1af4242504b4c7fa0903c7c61b02135. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:26:47.216713 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for user 5855c9996e4345aa8f71463648b6009e and project a1af4242504b4c7fa0903c7c61b02135. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:26:47.279469 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:26:47.282660 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd3cdbd3-b9df-487e-801e-3d4b77c0913a',volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:26:47.430261 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8caa6957-ba12-4815-a8a2-4ce244e83bcf tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.790930 Jun 24 10:26:47.430932 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 465/930] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:26:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:26:47.438881 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:47.439748 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=4 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:47.440415 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:47.444682 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-116155f8-ba79-4a33-8472-538f04414d14 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:47.446402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-116155f8-ba79-4a33-8472-538f04414d14 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:47.611426 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-116155f8-ba79-4a33-8472-538f04414d14 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:47.618131 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-116155f8-ba79-4a33-8472-538f04414d14 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1094 microversion: 2.1 time: 0.180722 Jun 24 10:26:47.618692 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 466/931] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:47 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1094 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:48.635575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:48.636211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:48.643484 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:48.643934 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:48.644704 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:48.645158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:48.714246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:48.722965 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9a4941bd-0e7b-4c9e-8dac-18d0b5264ae3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1210 microversion: 2.1 time: 0.091303 Jun 24 10:26:48.723781 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 466/932] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:48 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:49.741598 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:49.742168 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:49.749654 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:49.750099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:49.750988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:49.751679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:49.893047 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:49.900812 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-efb433bb-b1cf-4ca6-b4e1-e5021a580dea tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.163274 Jun 24 10:26:49.901389 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 467/933] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:49 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:50.131527 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-99ef1865-04c8-44f8-945b-1b3d36ba8f88 req-a226b4ee-66d3-46e8-9506-cc263ff94782 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73", "tag": "cfc83e60-4763-4b26-9114-c1a2ec52d4cb"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:50.141129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-99ef1865-04c8-44f8-945b-1b3d36ba8f88 req-a226b4ee-66d3-46e8-9506-cc263ff94782 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:50.141946 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-99ef1865-04c8-44f8-945b-1b3d36ba8f88 req-a226b4ee-66d3-46e8-9506-cc263ff94782 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:50.154030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-99ef1865-04c8-44f8-945b-1b3d36ba8f88 req-a226b4ee-66d3-46e8-9506-cc263ff94782 service nova] Creating event network-changed:cfc83e60-4763-4b26-9114-c1a2ec52d4cb for instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 on hv-cinder-84713 Jun 24 10:26:50.160328 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-99ef1865-04c8-44f8-945b-1b3d36ba8f88 req-a226b4ee-66d3-46e8-9506-cc263ff94782 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110413 Jun 24 10:26:50.161042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 467/934] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:26:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:50.917872 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:50.918609 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:50.925653 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:50.926098 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:50.926917 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:50.927351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:51.061106 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:51.070030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-404e06f6-e148-4c3c-b34c-6d67e9875316 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.155985 Jun 24 10:26:51.070623 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 468/935] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:50 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:52.093418 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:52.094525 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:52.105224 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:52.105976 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:52.107399 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:52.108131 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:52.259868 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:52.268067 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-94f0821a-78fc-4186-afe5-1ecae0b8d6fd tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.182728 Jun 24 10:26:52.268634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 468/936] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:52 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:53.293971 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:53.295005 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:53.305216 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:53.305956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:53.307258 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:53.307964 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:53.451051 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:53.462649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ab7cf0d8-47c1-4708-a855-e4013d81a128 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.175238 Jun 24 10:26:53.463384 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 469/937] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:53 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:54.485906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:54.486895 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:54.493918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:54.494354 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:54.495153 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:54.495584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:54.632683 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:54.640793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6972f9fa-fc03-4acc-84fa-bc4c457e1e21 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.161753 Jun 24 10:26:54.641363 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 469/938] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:54 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:55.663792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:55.664764 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:55.675888 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:55.676644 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:55.677930 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:55.678655 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:55.835178 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:55.843738 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f872afc8-12b1-4afa-8a4c-1123877e748c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.184521 Jun 24 10:26:55.844293 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 470/939] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:55 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:56.861293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:56.862132 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:56.869316 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:56.869786 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:56.870545 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:56.871018 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:57.005257 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:57.013347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ee0cddfb-9e97-42e1-825f-82db91344545 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.156215 Jun 24 10:26:57.013906 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 470/940] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:56 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:58.030725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:58.031331 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:58.033830 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:58.039838 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:58.040290 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:58.041044 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:58.041482 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:58.187277 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:58.195467 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0861948f-2eb4-4f93-860a-50850b1f4df2 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.168772 Jun 24 10:26:58.196247 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 471/941] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:58 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:58.477601 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:58.478238 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:58.480269 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:58.480948 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:26:58.490978 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:58.491726 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:58.492980 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:58.493919 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:58.521082 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-60970f46-bf6f-4549-a021-2554e17012a0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/ips" status: 200 len: 149 microversion: 2.1 time: 0.047457 Jun 24 10:26:58.521672 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 471/942] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:26:58 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:26:59.214075 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:26:59.214691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:59.222633 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:59.223101 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:59.223846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:59.224302 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:59.361908 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:26:59.373334 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-99961e1a-3032-4234-8738-bec30c96e333 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.164135 Jun 24 10:26:59.374046 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 472/943] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:26:59 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:26:59.917293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87e21dae-f73e-492d-9e20-ca2530dbb171"}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:26:59.918371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:26:59.925561 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:59.926012 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:26:59.926814 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:26:59.927255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:00.176246 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-5c2a6011-e8dc-4f69-8c18-ef7591affb96 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "POST /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.262827 Jun 24 10:27:00.177003 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 472/944] 10.222.0.64 () {60 vars in 1322 bytes} [Fri Jun 24 10:26:59 2022] POST /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:00.276333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-58614788-f59c-4d57-8b59-78579ae8c018 req-7c230e1f-32ac-401e-b723-c95096d5746d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73", "name": "network-vif-plugged", "status": "completed", "tag": "cfc83e60-4763-4b26-9114-c1a2ec52d4cb"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:00.285956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-58614788-f59c-4d57-8b59-78579ae8c018 req-7c230e1f-32ac-401e-b723-c95096d5746d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:00.287148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-58614788-f59c-4d57-8b59-78579ae8c018 req-7c230e1f-32ac-401e-b723-c95096d5746d service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:00.299234 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-58614788-f59c-4d57-8b59-78579ae8c018 req-7c230e1f-32ac-401e-b723-c95096d5746d service nova] Creating event network-vif-plugged:cfc83e60-4763-4b26-9114-c1a2ec52d4cb for instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 on hv-cinder-84713 Jun 24 10:27:00.304466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-58614788-f59c-4d57-8b59-78579ae8c018 req-7c230e1f-32ac-401e-b723-c95096d5746d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032189 Jun 24 10:27:00.305129 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 473/945] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:00.391545 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:00.392365 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:00.398821 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:00.399276 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:00.400046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:00.400477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:00.543146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:00.552064 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f5ae55d7-fe3c-40b2-ab5f-672b9857c7af tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.165321 Jun 24 10:27:00.552771 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 473/946] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:00 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:01.571328 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:01.571915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:01.579561 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:01.580090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:01.580846 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:01.581276 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:01.729200 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:01.737214 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-96f22915-16fa-4ef1-a2a1-3c2f2f7e9276 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1265 microversion: 2.1 time: 0.170268 Jun 24 10:27:01.737786 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 474/947] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:01 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:02.754675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:02.755312 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:02.762305 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:02.762788 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:02.763545 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:02.763982 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:02.910923 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:02.919187 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-98eba70d-909f-4d28-9d8f-b5b041b0f3a0 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1451 microversion: 2.1 time: 0.168472 Jun 24 10:27:02.919752 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 474/948] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:02 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1451 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:02.942211 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:02.942869 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:02.949658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:02.950099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:02.950890 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:02.951318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:03.088734 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:03.096915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e68c2639-4ca4-4d61-af0c-0886306ab006 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1451 microversion: 2.1 time: 0.159232 Jun 24 10:27:03.097481 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 475/949] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:02 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:05.141259 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-81b61e7b-70ba-4b82-b9e8-4ca61ca75ab4 req-95a6795d-0ba7-41aa-b6d7-262d60b49f8a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73", "tag": "cfc83e60-4763-4b26-9114-c1a2ec52d4cb"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:05.149642 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-81b61e7b-70ba-4b82-b9e8-4ca61ca75ab4 req-95a6795d-0ba7-41aa-b6d7-262d60b49f8a service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:05.150079 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-81b61e7b-70ba-4b82-b9e8-4ca61ca75ab4 req-95a6795d-0ba7-41aa-b6d7-262d60b49f8a service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:05.163838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-81b61e7b-70ba-4b82-b9e8-4ca61ca75ab4 req-95a6795d-0ba7-41aa-b6d7-262d60b49f8a service nova] Creating event network-changed:cfc83e60-4763-4b26-9114-c1a2ec52d4cb for instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 on hv-cinder-84713 Jun 24 10:27:05.168582 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-81b61e7b-70ba-4b82-b9e8-4ca61ca75ab4 req-95a6795d-0ba7-41aa-b6d7-262d60b49f8a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088720 Jun 24 10:27:05.169357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 475/950] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:07.798922 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:07.799575 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:07.806899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:07.807349 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:07.808134 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:07.808565 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:07.901224 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.objects.instance [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lazy-loading 'services' on Instance uuid 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 {{(pid=117854) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:27:07.985652 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e89f2976-e462-4d6d-ae46-f4cc36485c32 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments/87e21dae-f73e-492d-9e20-ca2530dbb171" status: 202 len: 0 microversion: 2.1 time: 0.190703 Jun 24 10:27:07.986428 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 476/951] 10.222.0.64 () {58 vars in 1415 bytes} [Fri Jun 24 10:27:07 2022] DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments/87e21dae-f73e-492d-9e20-ca2530dbb171 => generated 0 bytes in 192 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:27:07.996751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:07.997780 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:08.005046 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:08.005503 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:08.007207 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:08.007804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:08.039952 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-8a5fa750-202a-426b-93cd-d402375c456e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048178 Jun 24 10:27:08.040736 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 476/952] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:27:07 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:09.052688 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:09.053607 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:09.061347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:09.061799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:09.062585 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:09.063053 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:09.093129 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-69cdf4c5-e21c-44ea-8c95-df8d00f47947 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044956 Jun 24 10:27:09.093691 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 477/953] 10.222.0.64 () {58 vars in 1301 bytes} [Fri Jun 24 10:27:09 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 24 10:27:09.153175 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:09.153772 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:09.160965 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:09.161510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:09.162284 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:09.162768 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:09.189243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:27:09.270468 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3f4c6272-ef4f-4a10-bddb-eacdd805ec1c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 204 len: 0 microversion: 2.1 time: 0.121114 Jun 24 10:27:09.271114 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 477/954] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:27:09 2022] DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:27:09.279466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:09.280084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:09.286546 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:09.287030 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:09.287799 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:09.288265 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:09.420318 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:09.429084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d5868a72-33b4-4673-8a22-a7f5cb2e40b0 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1681 microversion: 2.1 time: 0.153349 Jun 24 10:27:09.429675 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 478/955] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:09 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:10.446675 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:10.447312 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:10.454795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:10.455854 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:10.456644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:10.457060 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:10.605464 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:10.614940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-b8b46bbd-df70-4841-a9ae-d6b1a2bf011e tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1681 microversion: 2.1 time: 0.172349 Jun 24 10:27:10.615752 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 478/956] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:10 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:11.633690 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:11.634512 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:11.642962 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:11.643582 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:11.644544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:11.645095 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:11.651674 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-5b3b99cd-b315-4eb3-8f6c-6b632397dd0f req-4530b96f-b68d-4cd8-9419-c31d2757fcbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12e6cd9d-142e-4fc4-a774-3b5f0f974f45", "name": "network-vif-deleted", "tag": "c497946e-5912-4677-908c-57e4aa280178"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:11.660587 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-5b3b99cd-b315-4eb3-8f6c-6b632397dd0f req-4530b96f-b68d-4cd8-9419-c31d2757fcbc service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:11.661032 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-5b3b99cd-b315-4eb3-8f6c-6b632397dd0f req-4530b96f-b68d-4cd8-9419-c31d2757fcbc service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:11.672923 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-5b3b99cd-b315-4eb3-8f6c-6b632397dd0f req-4530b96f-b68d-4cd8-9419-c31d2757fcbc service nova] Creating event network-vif-deleted:c497946e-5912-4677-908c-57e4aa280178 for instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 on hv-cinder-84713 Jun 24 10:27:11.678832 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-5b3b99cd-b315-4eb3-8f6c-6b632397dd0f req-4530b96f-b68d-4cd8-9419-c31d2757fcbc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030724 Jun 24 10:27:11.682523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 479/957] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:27:11.733549 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f96ee29f9c5b4651825da16d0520a0e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13b216e0dd4e46e2a2f4b275666118f6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:27:11.745581 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-60151b39-09f2-4ec0-acf7-57fa3e2e2ccb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 200 len: 1613 microversion: 2.1 time: 0.115696 Jun 24 10:27:11.756968 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 479/958] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:11 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 1613 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:27:12.770106 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:12.771311 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:12.782140 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:12.783213 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:12.784293 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:12.784775 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:12.799574 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 HTTP/1.1 Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:12.801275 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:12.803033 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '12e6cd9d-142e-4fc4-a774-3b5f0f974f45'} Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:12.804139 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:12.805757 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:12.807434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:12.807434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-917db025-531e-429f-b3bc-01be74c666b1 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 404 len: 111 microversion: 2.1 time: 0.041262 Jun 24 10:27:12.807434 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 480/959] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:12 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:12.811771 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-14101725-74d5-4a49-bf72-eebff82da9e4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '.version_select at 0x7f3774b78e50>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:12.832933 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-14101725-74d5-4a49-bf72-eebff82da9e4 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631175149" status: 202 len: 0 microversion: 2.1 time: 0.025068 Jun 24 10:27:12.833488 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 480/960] 10.222.0.64 () {58 vars in 1220 bytes} [Fri Jun 24 10:27:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631175149 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 24 10:27:14.587680 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:14.588233 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:14.595049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:14.595529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:14.596447 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:14.597083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:14.611099 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 HTTP/1.1 Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:14.612909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.614575 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '12e6cd9d-142e-4fc4-a774-3b5f0f974f45'} Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:14.615804 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.617277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.619083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:14.619083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-50046112-ee88-49f7-8603-49cd8cd55bdb tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 404 len: 111 microversion: 2.1 time: 0.030915 Jun 24 10:27:14.619083 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 481/961] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:27:14 2022] DELETE /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:14.623544 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:14.624152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 12e6cd9d-142e-4fc4-a774-3b5f0f974f45] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:14.631216 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:14.631665 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:14.632432 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:14.632904 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:14.647111 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 HTTP/1.1 Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:14.648792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.650404 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '12e6cd9d-142e-4fc4-a774-3b5f0f974f45'} Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:14.651217 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. Jun 24 10:27:14.652506 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:14.653629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 12e6cd9d-142e-4fc4-a774-3b5f0f974f45 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:14.653629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ef88af9b-b85a-4b9b-ab4e-63528c0d606c tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45" status: 404 len: 111 microversion: 2.1 time: 0.031175 Jun 24 10:27:14.653629 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 481/962] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:14 2022] GET /compute/v2.1/servers/12e6cd9d-142e-4fc4-a774-3b5f0f974f45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 24 10:27:15.796041 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:15.796643 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:15.803799 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.804286 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.805063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.805509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.819925 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f HTTP/1.1 Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:15.821516 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.823288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f'} Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:15.824317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.825918 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.827716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:15.827716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-6b5316a2-6fea-4545-bbeb-d66bfd534873 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 404 len: 111 microversion: 2.1 time: 0.030832 Jun 24 10:27:15.827716 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 482/963] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:27:15 2022] DELETE /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:15.831892 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:15.832489 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:15.839760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.840199 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.840981 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.841408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.855449 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f HTTP/1.1 Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:15.856995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.858529 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f'} Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:15.859696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. Jun 24 10:27:15.861229 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.863411 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:15.863411 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-92d9f82b-8f9e-407a-a97d-35383a625fea tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f" status: 404 len: 111 microversion: 2.1 time: 0.030849 Jun 24 10:27:15.863411 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 482/964] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:15 2022] GET /compute/v2.1/servers/0c3ee2e6-ecd8-4261-ab1b-f8a139ba927f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:15.867585 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:15.868129 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:15.874732 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.875192 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.875968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.876395 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.890473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 HTTP/1.1 Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:15.892062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.893971 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '847c5da0-048e-4f9e-bf9b-05be65fafd89'} Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:15.894802 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.896101 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.897369 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:15.897369 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9469307a-1475-433f-bc4d-f6ddd4154859 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 404 len: 111 microversion: 2.1 time: 0.029835 Jun 24 10:27:15.897369 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 483/965] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:27:15 2022] DELETE /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:15.902870 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:15.903488 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 847c5da0-048e-4f9e-bf9b-05be65fafd89] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:15.909829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.910320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.911101 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:15.911539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:15.925597 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 HTTP/1.1 Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:15.927226 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.928950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '847c5da0-048e-4f9e-bf9b-05be65fafd89'} Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:15.930083 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. Jun 24 10:27:15.931643 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:15.933099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 847c5da0-048e-4f9e-bf9b-05be65fafd89 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:15.933099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e3c0cb0a-874f-4bd3-84a8-3ab6b2652495 tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89" status: 404 len: 111 microversion: 2.1 time: 0.029709 Jun 24 10:27:15.933099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 483/966] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:15 2022] GET /compute/v2.1/servers/847c5da0-048e-4f9e-bf9b-05be65fafd89 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:17.069263 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:17.069829 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:17.072318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:27:17.077712 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:17.078173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:17.078968 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:17.079407 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:17.082967 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:27:17.099735 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da HTTP/1.1 Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:17.101562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.103266 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '725b1a67-bbbe-48c8-8838-a7b65cedf8da'} Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:17.104138 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.105410 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.106689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:17.106689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-08cd6925-178a-4ccc-9f41-3e20ff55d7ac tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 404 len: 111 microversion: 2.1 time: 0.037776 Jun 24 10:27:17.106689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 484/967] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:27:17 2022] DELETE /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:17.113167 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:17.113785 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] [instance: 725b1a67-bbbe-48c8-8838-a7b65cedf8da] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:27:17.120699 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:17.121154 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:17.121913 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:27:17.122351 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:27:17.136099 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] HTTP exception thrown: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Request method failure captured: Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da HTTP/1.1 Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZCBs9l9p3zOnSdz9GMC2n5g3E_2sLG1HT4t70KjH84VK1baL_3vjXh6VuDrSyKrfGg1y8ZUDkTRXRkA5QY_M9VhxJhoE0wLiQlIEqsuEv2_qJH-osMeHbPrDKO2N6p074EmtNMzgMRvs_TmvtB3jaiZZRaRCkHOxlwsrye4XINLe6k Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:17.137645 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_13b216e0dd4e46e2a2f4b275666118f6", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/13b216e0dd4e46e2a2f4b275666118f6"}]}] Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 13b216e0dd4e46e2a2f4b275666118f6 Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1237754022 Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: f96ee29f9c5b4651825da16d0520a0e8 Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-AttachVolumeNegativeTest-1237754022-project Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.139215 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '725b1a67-bbbe-48c8-8838-a7b65cedf8da'} Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:17.140140 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. Jun 24 10:27:17.141703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:17.143601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] Returning 404 to user: Instance 725b1a67-bbbe-48c8-8838-a7b65cedf8da could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:17.143601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-37efd9f6-ad3a-4156-9451-037f9738dd9b tempest-AttachVolumeNegativeTest-1237754022 tempest-AttachVolumeNegativeTest-1237754022-project] 10.222.0.64 "GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da" status: 404 len: 111 microversion: 2.1 time: 0.030807 Jun 24 10:27:17.143601 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 484/968] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:27:17 2022] GET /compute/v2.1/servers/725b1a67-bbbe-48c8-8838-a7b65cedf8da => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:21.604062 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-e0db5c27-0df5-4081-9bfe-3ae9d48951ae tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Action: 'create', calling method: .version_select at 0x7f3774badaf0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-267280176", "metadata": {"Type": "work"}}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:21.906999 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-e0db5c27-0df5-4081-9bfe-3ae9d48951ae tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.424379 Jun 24 10:27:21.907739 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 485/969] 10.222.0.64 () {60 vars in 1155 bytes} [Fri Jun 24 10:27:21 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 426 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 24 10:27:21.919137 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-27011e85-bf70-4ca1-8c5e-15560676fe69 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Calling method '.version_select at 0x7f3774a00c10>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:21.970836 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-27011e85-bf70-4ca1-8c5e-15560676fe69 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37" status: 200 len: 352 microversion: 2.1 time: 0.055728 Jun 24 10:27:21.971408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 485/970] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:27:21 2022] GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 => generated 352 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:22.984496 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a2e23af1-6152-4a4d-b889-55251d7be999 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Calling method '.version_select at 0x7f3774b5aaf0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:23.034390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a2e23af1-6152-4a4d-b889-55251d7be999 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37" status: 200 len: 353 microversion: 2.1 time: 0.054239 Jun 24 10:27:23.035038 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 486/971] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:27:22 2022] GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:23.046742 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3f6372fc-0429-4424-bec8-19f23f9101f9 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Calling method '.version_select at 0x7f37748fbdc0>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:23.097554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3f6372fc-0429-4424-bec8-19f23f9101f9 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37" status: 200 len: 353 microversion: 2.1 time: 0.055175 Jun 24 10:27:23.098120 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 486/972] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:27:23 2022] GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:23.109867 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0147610e-0233-445c-b1eb-736c7ae83d5e tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Calling method '.version_select at 0x7f3774b68e50>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:23.178044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0147610e-0233-445c-b1eb-736c7ae83d5e tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37" status: 202 len: 0 microversion: 2.1 time: 0.071898 Jun 24 10:27:23.178732 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 487/973] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:27:23 2022] DELETE /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:27:23.187146 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-2aaea89a-4c6e-4e2b-a868-fddebdcc8322 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Calling method '.version_select at 0x7f3774ad6670>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:23.238220 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-2aaea89a-4c6e-4e2b-a868-fddebdcc8322 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37" status: 200 len: 352 microversion: 2.1 time: 0.054981 Jun 24 10:27:23.238844 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 487/974] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:27:23 2022] GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:27:24.251823 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-560aa143-aa3c-4414-bc42-118866ca56b2 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Calling method '.version_select at 0x7f37774baaf0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:24.280423 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-560aa143-aa3c-4414-bc42-118866ca56b2 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] HTTP exception thrown: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-560aa143-aa3c-4414-bc42-118866ca56b2 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Request method failure captured: Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 HTTP/1.1 Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZGJbKIK7NaUQ3R3zJlsXYoWgd4JRPtj7ejVEmP8VqFLpYmY1hrTOUEAVBpCw53Tp9MxKd7RIIo2Q6Dm_0shwo6rk2joatgCCokHYqOztiqWNAsKgT9pAZCbQJFcIddZ7eeYGv9NAlelS9r6V8P7nvePBIvOhLOuRBEGlOPOVGqyh28 Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: f4fed92cd7454c0b8c682408358d1edc Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-VolumesGetTestJSON-1710394638 Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:24.284100 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/f4fed92cd7454c0b8c682408358d1edc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_f4fed92cd7454c0b8c682408358d1edc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f4fed92cd7454c0b8c682408358d1edc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/f4fed92cd7454c0b8c682408358d1edc"}]}] Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-VolumesGetTestJSON-1710394638 Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: f4fed92cd7454c0b8c682408358d1edc Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-VolumesGetTestJSON-1710394638 Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-VolumesGetTestJSON-1710394638-project Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 33dc946289b94e57b10472973bcdf3cf Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-VolumesGetTestJSON-1710394638-project Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '3f9a3792-223d-45d4-a5da-8bbf9b0f1a37'} Jun 24 10:27:24.285750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. (HTTP 404) (Request-ID: req-cb20ab7e-e611-4ddc-848b-aadc2ad295b1) Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:24.286865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:27:24.288397 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:27:24.289869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-560aa143-aa3c-4414-bc42-118866ca56b2 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] Returning 404 to user: Volume 3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-560aa143-aa3c-4414-bc42-118866ca56b2 tempest-VolumesGetTestJSON-1710394638 tempest-VolumesGetTestJSON-1710394638-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37" status: 404 len: 109 microversion: 2.1 time: 0.038491 Jun 24 10:27:24.291373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 488/975] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:27:24 2022] GET /compute/v2.1/os-volumes/3f9a3792-223d-45d4-a5da-8bbf9b0f1a37 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:25.728786 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-118e482e-a5b5-494b-ab20-40de81bff80b tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Action: 'create', calling method: .version_select at 0x7f3774b78430>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2074932613", "metadata": {"Type": "work"}}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-118e482e-a5b5-494b-ab20-40de81bff80b tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Request method failure captured: Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 122 Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZGNHN9nA47lwQU0ZJS6iJ_YNoxPZbS-jMdt_MF5ckUWuDlLcnKoy3XvdTrlAY8GHRQkzzkE0mxi1_Mw0bWR1BtTe18tZ02Eco44Alt9f6Lc2V-UnTYXAfEom3bajm0PJPLnIB_cL0lQbvh0Q-h2w_M4S6J1vjgEr8DyuAvDcBQd3JY Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:25.757060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_411d7bb7706b460593e96a49cbd4b0df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}] Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 64696d7676744506b938a2f64c1fefca Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-2074932613", "metadata": {"Type": "work"}}} Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:27:25.758829 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-2074932613', 'metadata': {'Type': 'work'}}}} Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi '#$%' Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:25.759802 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:27:25.761434 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:27:25.762954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 24 10:27:25.762954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.762954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-118e482e-a5b5-494b-ab20-40de81bff80b tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:25.762954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-118e482e-a5b5-494b-ab20-40de81bff80b tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149247 Jun 24 10:27:25.762954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 488/976] 10.222.0.64 () {60 vars in 1155 bytes} [Fri Jun 24 10:27:25 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 150 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:27:25.769624 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7694f34c-3ec4-4fc4-9ffb-58b8fee652e5 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Action: 'create', calling method: .version_select at 0x7f3774afe280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1285440853", "metadata": {"Type": "work"}}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7694f34c-3ec4-4fc4-9ffb-58b8fee652e5 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Request method failure captured: Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 120 Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZGNHN9nA47lwQU0ZJS6iJ_YNoxPZbS-jMdt_MF5ckUWuDlLcnKoy3XvdTrlAY8GHRQkzzkE0mxi1_Mw0bWR1BtTe18tZ02Eco44Alt9f6Lc2V-UnTYXAfEom3bajm0PJPLnIB_cL0lQbvh0Q-h2w_M4S6J1vjgEr8DyuAvDcBQd3JY Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:25.773830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_411d7bb7706b460593e96a49cbd4b0df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}] Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 64696d7676744506b938a2f64c1fefca Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1285440853", "metadata": {"Type": "work"}}} Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: Jun 24 10:27:25.775573 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1285440853', 'metadata': {'Type': 'work'}}}} Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi '0' Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:25.776494 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:27:25.777877 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:27:25.779098 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 24 10:27:25.779098 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.779098 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7694f34c-3ec4-4fc4-9ffb-58b8fee652e5 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:25.779098 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7694f34c-3ec4-4fc4-9ffb-58b8fee652e5 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010532 Jun 24 10:27:25.779098 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 489/977] 10.222.0.64 () {60 vars in 1155 bytes} [Fri Jun 24 10:27:25 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:27:25.787184 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b9904788-c13b-4688-a869-140d8f1df366 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Action: 'create', calling method: .version_select at 0x7f3774deef70>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1734174728", "metadata": {"Type": "work"}}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b9904788-c13b-4688-a869-140d8f1df366 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Request method failure captured: Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 119 Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZGNHN9nA47lwQU0ZJS6iJ_YNoxPZbS-jMdt_MF5ckUWuDlLcnKoy3XvdTrlAY8GHRQkzzkE0mxi1_Mw0bWR1BtTe18tZ02Eco44Alt9f6Lc2V-UnTYXAfEom3bajm0PJPLnIB_cL0lQbvh0Q-h2w_M4S6J1vjgEr8DyuAvDcBQd3JY Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:25.789510 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_411d7bb7706b460593e96a49cbd4b0df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}] Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 64696d7676744506b938a2f64c1fefca Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1734174728", "metadata": {"Type": "work"}}} Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:27:25.791257 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1734174728', 'metadata': {'Type': 'work'}}}} Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise error Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi '' Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:25.792291 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 24 10:27:25.793937 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 24 10:27:25.795814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 24 10:27:25.795814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.795814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b9904788-c13b-4688-a869-140d8f1df366 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:25.795814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b9904788-c13b-4688-a869-140d8f1df366 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009609 Jun 24 10:27:25.795814 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 489/978] 10.222.0.64 () {60 vars in 1155 bytes} [Fri Jun 24 10:27:25 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 24 10:27:25.802562 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9371f53f-b517-4a6c-8c74-0bdd0d8d3cf8 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Calling method '.version_select at 0x7f3774b971f0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:25.836774 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-9371f53f-b517-4a6c-8c74-0bdd0d8d3cf8 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] HTTP exception thrown: Volume tempest-invalid-904900802 could not be found. Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9371f53f-b517-4a6c-8c74-0bdd0d8d3cf8 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Request method failure captured: Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-904900802 HTTP/1.1 Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZGNHN9nA47lwQU0ZJS6iJ_YNoxPZbS-jMdt_MF5ckUWuDlLcnKoy3XvdTrlAY8GHRQkzzkE0mxi1_Mw0bWR1BtTe18tZ02Eco44Alt9f6Lc2V-UnTYXAfEom3bajm0PJPLnIB_cL0lQbvh0Q-h2w_M4S6J1vjgEr8DyuAvDcBQd3JY Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:25.838842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_411d7bb7706b460593e96a49cbd4b0df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}] Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 64696d7676744506b938a2f64c1fefca Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Volume tempest-invalid-904900802 could not be found. Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'tempest-invalid-904900802'} Jun 24 10:27:25.840510 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-904900802 could not be found. (HTTP 404) (Request-ID: req-dff63a0e-d731-4cac-a255-17ff08be6c48) Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.841445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:27:25.842652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-904900802 could not be found. Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:25.844824 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-904900802 could not be found. Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-904900802 could not be found. Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9371f53f-b517-4a6c-8c74-0bdd0d8d3cf8 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Returning 404 to user: Volume tempest-invalid-904900802 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9371f53f-b517-4a6c-8c74-0bdd0d8d3cf8 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-904900802" status: 404 len: 98 microversion: 2.1 time: 0.042034 Jun 24 10:27:25.846769 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 490/979] 10.222.0.64 () {58 vars in 1214 bytes} [Fri Jun 24 10:27:25 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-904900802 => generated 98 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jun 24 10:27:25.850915 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-68840160-11f1-498d-aca4-dd04d377677e tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003826 Jun 24 10:27:25.851457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 490/980] 10.222.0.64 () {58 vars in 1139 bytes} [Fri Jun 24 10:27:25 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 10:27:25.860543 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0c7b914b-3a3f-4332-8784-edcfaaef461a tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003831 Jun 24 10:27:25.861311 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 491/981] 10.222.0.64 () {58 vars in 1136 bytes} [Fri Jun 24 10:27:25 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 24 10:27:25.870481 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8b1e7602-fc94-4c27-ac89-c513dffa4262 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Calling method '.version_select at 0x7f3774a56f70>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:25.898998 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-8b1e7602-fc94-4c27-ac89-c513dffa4262 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] HTTP exception thrown: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8b1e7602-fc94-4c27-ac89-c513dffa4262 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Request method failure captured: Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: DELETE /compute/v2.1/os-volumes/fa955112-e87d-4bc6-b967-2becd2c05bbc HTTP/1.1 Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZGNHN9nA47lwQU0ZJS6iJ_YNoxPZbS-jMdt_MF5ckUWuDlLcnKoy3XvdTrlAY8GHRQkzzkE0mxi1_Mw0bWR1BtTe18tZ02Eco44Alt9f6Lc2V-UnTYXAfEom3bajm0PJPLnIB_cL0lQbvh0Q-h2w_M4S6J1vjgEr8DyuAvDcBQd3JY Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:27:25.900956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_411d7bb7706b460593e96a49cbd4b0df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}] Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 64696d7676744506b938a2f64c1fefca Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'fa955112-e87d-4bc6-b967-2becd2c05bbc'} Jun 24 10:27:25.902568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. (HTTP 404) (Request-ID: req-46fdbb2c-f405-4de5-8916-c3eddddc3fa0) Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.903638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 24 10:27:25.905148 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 24 10:27:25.906560 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8b1e7602-fc94-4c27-ac89-c513dffa4262 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Returning 404 to user: Volume fa955112-e87d-4bc6-b967-2becd2c05bbc could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8b1e7602-fc94-4c27-ac89-c513dffa4262 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/fa955112-e87d-4bc6-b967-2becd2c05bbc" status: 404 len: 109 microversion: 2.1 time: 0.035901 Jun 24 10:27:25.908408 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 491/982] 10.222.0.64 () {58 vars in 1247 bytes} [Fri Jun 24 10:27:25 2022] DELETE /compute/v2.1/os-volumes/fa955112-e87d-4bc6-b967-2becd2c05bbc => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:27:25.913171 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3e4d74b1-033f-4c2c-b6c9-dd115f94fcc1 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Calling method '.version_select at 0x7f3774afe430>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:27:25.942042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-3e4d74b1-033f-4c2c-b6c9-dd115f94fcc1 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] HTTP exception thrown: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3e4d74b1-033f-4c2c-b6c9-dd115f94fcc1 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Request method failure captured: Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/os-volumes/15474974-acdc-4275-ab9e-8bd84b2774da HTTP/1.1 Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZGNHN9nA47lwQU0ZJS6iJ_YNoxPZbS-jMdt_MF5ckUWuDlLcnKoy3XvdTrlAY8GHRQkzzkE0mxi1_Mw0bWR1BtTe18tZ02Eco44Alt9f6Lc2V-UnTYXAfEom3bajm0PJPLnIB_cL0lQbvh0Q-h2w_M4S6J1vjgEr8DyuAvDcBQd3JY Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:27:25.944059 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_411d7bb7706b460593e96a49cbd4b0df", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/411d7bb7706b460593e96a49cbd4b0df"}]}] Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: 411d7bb7706b460593e96a49cbd4b0df Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-VolumesNegativeTest-1888040763 Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 64696d7676744506b938a2f64c1fefca Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-VolumesNegativeTest-1888040763-project Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': '15474974-acdc-4275-ab9e-8bd84b2774da'} Jun 24 10:27:25.945717 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. (HTTP 404) (Request-ID: req-5061ad3b-257a-472f-bb9e-db18c506cced) Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.946751 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 24 10:27:25.948211 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 24 10:27:25.949628 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-3e4d74b1-033f-4c2c-b6c9-dd115f94fcc1 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] Returning 404 to user: Volume 15474974-acdc-4275-ab9e-8bd84b2774da could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-3e4d74b1-033f-4c2c-b6c9-dd115f94fcc1 tempest-VolumesNegativeTest-1888040763 tempest-VolumesNegativeTest-1888040763-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/15474974-acdc-4275-ab9e-8bd84b2774da" status: 404 len: 109 microversion: 2.1 time: 0.036942 Jun 24 10:27:25.951118 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 492/983] 10.222.0.64 () {58 vars in 1244 bytes} [Fri Jun 24 10:27:25 2022] GET /compute/v2.1/os-volumes/15474974-acdc-4275-ab9e-8bd84b2774da => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:28:59.358997 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=41,nova_api:DELETE=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:59.359786 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:59.365273 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:59.365792 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:28:59.374466 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:28:59.374942 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:28:59.375695 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:28:59.376143 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:28:59.409307 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Going to try to terminate instance {{(pid=117854) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:28:59.494116 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-8cee6d71-68a7-4fd4-8764-2034cd9533f4 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 204 len: 0 microversion: 2.1 time: 0.137159 Jun 24 10:28:59.497781 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 492/984] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:28:59 2022] DELETE /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:28:59.502277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:59.504330 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=1 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:28:59.510237 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:28:59.510878 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:28:59.518114 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:28:59.518565 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:28:59.519373 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:28:59.519809 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:28:59.665556 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:28:59.675244 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-02d08a62-0ed4-46ab-bb43-fabb21a6646c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1576 microversion: 2.1 time: 0.175205 Jun 24 10:28:59.676072 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 493/985] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:28:59 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1576 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:00.694018 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:00.694676 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:00.701703 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:00.702147 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:00.702924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:00.703356 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:00.842424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:00.850669 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-74bdee64-d47d-4bf2-b224-032fd35d8668 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1576 microversion: 2.1 time: 0.160990 Jun 24 10:29:00.851235 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 493/986] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:00 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:01.842542 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-2b61d229-111e-4adb-b31e-9894394a51d3 req-d99c61ef-33af-4b85-b828-1ca74fc1aa19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73", "name": "network-vif-deleted", "tag": "cfc83e60-4763-4b26-9114-c1a2ec52d4cb"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:01.851940 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2b61d229-111e-4adb-b31e-9894394a51d3 req-d99c61ef-33af-4b85-b828-1ca74fc1aa19 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:01.852588 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2b61d229-111e-4adb-b31e-9894394a51d3 req-d99c61ef-33af-4b85-b828-1ca74fc1aa19 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:01.866810 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-2b61d229-111e-4adb-b31e-9894394a51d3 req-d99c61ef-33af-4b85-b828-1ca74fc1aa19 service nova] Creating event network-vif-deleted:cfc83e60-4763-4b26-9114-c1a2ec52d4cb for instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 on hv-cinder-84713 Jun 24 10:29:01.871202 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:01.872739 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:01.880347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:01.880811 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:01.881640 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:01.885369 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-2b61d229-111e-4adb-b31e-9894394a51d3 req-d99c61ef-33af-4b85-b828-1ca74fc1aa19 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045621 Jun 24 10:29:01.886300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:01.888977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 494/987] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:29:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:01.966230 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:01.974568 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-110dabbc-3a4d-498c-888e-1ada0a3b526a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 200 len: 1225 microversion: 2.1 time: 0.108945 Jun 24 10:29:01.975197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 494/988] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:01 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 1225 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:02.993529 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:02.994182 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:03.001040 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:03.001503 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:03.002278 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:03.002733 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:03.016851 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] HTTP exception thrown: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Request method failure captured: Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 HTTP/1.1 Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZFQN9CJq6oxIEGzPsSsEHRgOyMKF-dtBIg6PZHLbdWQ-wmC2MzgfHUoC2cVSINOoT6F0MnbvZm70xIbRGuBxdEiA5H5DvfRqrR1d1HxBewjUK_-3DDVHmYHmXh47b0NFqy0cOvRfPlY01x-H5poqI-lWoJU0p17E3RkRKXhOgtKN6c Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:29:03.018498 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a1af4242504b4c7fa0903c7c61b02135", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}] Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 5855c9996e4345aa8f71463648b6009e Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:29:03.020334 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73'} Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:29:03.021265 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:29:03.022759 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:29:03.024708 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Returning 404 to user: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:29:03.024708 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-17ffcd38-f928-42fd-88f7-ffa8b1674ed6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 404 len: 111 microversion: 2.1 time: 0.031472 Jun 24 10:29:03.024708 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 495/989] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:02 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:29:03.143304 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1331239503", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-197236867", "security_groups": [{"name": "tempest-secgroup-smoke-511313019"}], "block_device_mapping_v2": [{"uuid": "dd3cdbd3-b9df-487e-801e-3d4b77c0913a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "974e48a5-8005-4f80-8ebd-0fd83f94a22c"}]}} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:03.259086 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.network.neutron [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] validate_networks() for [('974e48a5-8005-4f80-8ebd-0fd83f94a22c', None, None, None, None, None)] {{(pid=117854) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:29:03.793871 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Flavor limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:29:03.794307 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Image limits 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:29:03.794822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Flavor pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:29:03.795234 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Image pref 0:0:0 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:29:03.795671 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.virt.hardware [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117854) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:29:03.805223 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:03.805679 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:03.806486 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:03.806954 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:03.825783 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for project a1af4242504b4c7fa0903c7c61b02135. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:29:03.832345 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.quota [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for user 5855c9996e4345aa8f71463648b6009e and project a1af4242504b4c7fa0903c7c61b02135. Resources: {'ram', 'instances', 'cores'} {{(pid=117854) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:29:03.892973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Going to run 1 instances... {{(pid=117854) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:29:03.895137 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='dd3cdbd3-b9df-487e-801e-3d4b77c0913a',volume_size=None,volume_type=None)] {{(pid=117854) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:29:04.037190 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-0cab92c3-214e-4d8a-8ecb-2a692478fc75 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.897770 Jun 24 10:29:04.037822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 495/990] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:29:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:29:04.049795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-20f80805-f013-4a07-91ad-d7b14465e1e3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:04.050413 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-20f80805-f013-4a07-91ad-d7b14465e1e3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:04.108693 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-20f80805-f013-4a07-91ad-d7b14465e1e3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:04.117238 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-20f80805-f013-4a07-91ad-d7b14465e1e3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1094 microversion: 2.1 time: 0.071297 Jun 24 10:29:04.118599 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 496/991] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:04 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:05.139197 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:05.139840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:05.146893 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:05.147301 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:05.148309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:05.148955 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:05.219025 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:05.228055 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-d51d638d-9d23-4496-bd1c-779dab3c73b1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1200 microversion: 2.1 time: 0.094718 Jun 24 10:29:05.228619 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 496/992] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:05 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1200 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:06.255400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:06.255400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:06.255400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:06.255400 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:06.256322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:06.256322 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:06.412454 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:06.421314 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4c9151dc-4f39-4fb1-9b23-aee0607e269c tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.179327 Jun 24 10:29:06.431656 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 497/993] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:06 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:06.687212 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-07c231ae-0d39-4ca3-b2ff-f36fe02b7ae5 req-513df02d-1d16-4ebc-a36f-928975e3d8ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3a026c-235f-4a5d-bf09-ae6e1c13f888", "tag": "1b531ede-6da7-4696-9e82-2fe054e3a392"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:06.704319 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-07c231ae-0d39-4ca3-b2ff-f36fe02b7ae5 req-513df02d-1d16-4ebc-a36f-928975e3d8ae service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:06.705060 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-07c231ae-0d39-4ca3-b2ff-f36fe02b7ae5 req-513df02d-1d16-4ebc-a36f-928975e3d8ae service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:06.730596 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-07c231ae-0d39-4ca3-b2ff-f36fe02b7ae5 req-513df02d-1d16-4ebc-a36f-928975e3d8ae service nova] Creating event network-changed:1b531ede-6da7-4696-9e82-2fe054e3a392 for instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 on hv-cinder-84713 Jun 24 10:29:06.737455 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-07c231ae-0d39-4ca3-b2ff-f36fe02b7ae5 req-513df02d-1d16-4ebc-a36f-928975e3d8ae service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053861 Jun 24 10:29:06.738328 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 497/994] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:29:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:07.440374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:07.441810 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:07.448689 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:07.449146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:07.449931 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:07.450422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:07.601256 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:07.613200 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-efb29c83-88cb-48ee-bf27-bf2416ffe468 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.176879 Jun 24 10:29:07.614172 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 498/995] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:07 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:08.635341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:08.636023 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:08.642649 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:08.643128 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:08.643884 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:08.644311 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:08.790141 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:08.798950 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-e8ec16b9-d12d-4d7e-9318-09b05a78c162 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.168393 Jun 24 10:29:08.799519 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 498/996] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:08 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:09.817989 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:09.818645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:09.827049 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:09.827513 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:09.828441 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:09.828954 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:09.976487 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:09.986443 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-89387a3e-27c0-4af4-8528-bfaed447ae59 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.173683 Jun 24 10:29:09.987057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 499/997] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:09 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:11.003840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:11.004441 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:11.011890 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:11.012339 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:11.013127 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:11.013559 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:11.156443 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:11.167840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-fc2bfd24-814d-4c46-adb9-80a85c3622f6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.167993 Jun 24 10:29:11.168497 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 499/998] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:10 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:12.188282 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:12.188909 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:12.195789 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:12.196242 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:12.196992 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:12.197431 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:12.332142 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:12.340547 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f76b81f7-dce8-40c4-bec1-8f72488c7825 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.156459 Jun 24 10:29:12.341151 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 500/999] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:12 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:13.358868 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:13.359539 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:13.366856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:13.367300 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:13.368069 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:13.368511 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:13.513447 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:13.522554 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-971e5179-020d-4f9c-a7c9-13630fe10c53 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.168278 Jun 24 10:29:13.523150 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 500/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:13 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:14.543669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:14.544389 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:14.548272 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:29:14.555220 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:14.555660 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:14.556428 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:14.556858 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:14.702866 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:14.711152 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d20c14af-b259-4a92-a0eb-bc6d78e9903f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.173165 Jun 24 10:29:14.712131 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 501/1001] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:14 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:15.728924 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:15.729538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:15.731572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:29:15.732251 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=6 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:29:15.739317 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:15.739767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:15.740536 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:15.740975 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:15.881828 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:15.890348 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-17ebf8a7-f1c4-4e4e-b84c-134a6a82a6c3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.165344 Jun 24 10:29:15.890965 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 501/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:15 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:16.907315 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:16.909274 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:16.915905 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:16.916357 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:16.917432 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:16.918176 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:17.061820 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:17.070583 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-a7ac3d21-424d-45f6-879d-84e1873b5026 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.167079 Jun 24 10:29:17.071251 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 502/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:16 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:17.293927 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-a9efd1eb-5d77-4789-a04f-4bee0f84c140 req-ec30b1bf-6ac0-4ac5-abab-8f56e01f5fba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3a026c-235f-4a5d-bf09-ae6e1c13f888", "name": "network-vif-plugged", "status": "completed", "tag": "1b531ede-6da7-4696-9e82-2fe054e3a392"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:17.302588 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-a9efd1eb-5d77-4789-a04f-4bee0f84c140 req-ec30b1bf-6ac0-4ac5-abab-8f56e01f5fba service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:17.303314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-a9efd1eb-5d77-4789-a04f-4bee0f84c140 req-ec30b1bf-6ac0-4ac5-abab-8f56e01f5fba service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:17.315074 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-a9efd1eb-5d77-4789-a04f-4bee0f84c140 req-ec30b1bf-6ac0-4ac5-abab-8f56e01f5fba service nova] Creating event network-vif-plugged:1b531ede-6da7-4696-9e82-2fe054e3a392 for instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 on hv-cinder-84713 Jun 24 10:29:17.320377 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-a9efd1eb-5d77-4789-a04f-4bee0f84c140 req-ec30b1bf-6ac0-4ac5-abab-8f56e01f5fba service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.191101 Jun 24 10:29:17.320973 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 502/1004] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:29:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:18.088428 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:18.089227 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:18.096226 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:18.096696 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:18.097481 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:18.097959 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:18.237456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:18.245523 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d0aec5e5-682c-48e7-b364-a75168d55579 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1265 microversion: 2.1 time: 0.161111 Jun 24 10:29:18.246061 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 503/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:18 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:19.263845 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:19.264617 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:19.271673 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:19.272120 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:19.272902 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:19.273340 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:19.409562 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:19.418664 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7b36577c-716a-4845-8c0c-c484d2b6e5cc tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1452 microversion: 2.1 time: 0.159712 Jun 24 10:29:19.419353 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 503/1006] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:19 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:19.436475 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:29:19.437086 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:29:19.444422 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:19.444874 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:19.445634 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:19.446074 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:19.590477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:29:19.598627 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-9a49f8a5-ccf0-4548-aea9-bcd83ab597d6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1452 microversion: 2.1 time: 0.166045 Jun 24 10:29:19.599243 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 504/1007] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:29:19 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1452 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:29:21.559275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-5d98b5eb-8950-4cda-85e3-979b6b43a123 req-de6cdb91-aa07-4be7-9bc0-a20642677a77 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3a026c-235f-4a5d-bf09-ae6e1c13f888", "tag": "1b531ede-6da7-4696-9e82-2fe054e3a392"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:29:21.569530 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-5d98b5eb-8950-4cda-85e3-979b6b43a123 req-de6cdb91-aa07-4be7-9bc0-a20642677a77 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:29:21.570320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-5d98b5eb-8950-4cda-85e3-979b6b43a123 req-de6cdb91-aa07-4be7-9bc0-a20642677a77 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:29:21.584042 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-5d98b5eb-8950-4cda-85e3-979b6b43a123 req-de6cdb91-aa07-4be7-9bc0-a20642677a77 service nova] Creating event network-changed:1b531ede-6da7-4696-9e82-2fe054e3a392 for instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 on hv-cinder-84713 Jun 24 10:29:21.589102 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-5d98b5eb-8950-4cda-85e3-979b6b43a123 req-de6cdb91-aa07-4be7-9bc0-a20642677a77 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033558 Jun 24 10:29:21.590161 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 504/1008] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:29:37.242884 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:29:37.243620 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:29:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:29:46.191664 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:29:46.192319 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Fri Jun 24 10:29:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:30:55.740030 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=26 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:55.740825 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=58 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:55.744928 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1726334805", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-197236867", "security_groups": [{"name": "tempest-secgroup-smoke-511313019"}], "block_device_mapping_v2": [{"uuid": "3a6fea2b-307e-4ae4-a632-91a71e989564", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "974e48a5-8005-4f80-8ebd-0fd83f94a22c"}]}} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:30:55.880175 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.network.neutron [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] validate_networks() for [('974e48a5-8005-4f80-8ebd-0fd83f94a22c', None, None, None, None, None)] {{(pid=117855) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 24 10:30:56.322722 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Flavor limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 24 10:30:56.323166 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Image limits 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 24 10:30:56.323635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Flavor pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 24 10:30:56.324042 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Image pref 0:0:0 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 24 10:30:56.324450 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.virt.hardware [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117855) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 24 10:30:56.334445 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:56.334933 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:56.335732 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:56.336162 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:56.355053 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for project a1af4242504b4c7fa0903c7c61b02135. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 24 10:30:56.359226 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.quota [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Getting quotas for user 5855c9996e4345aa8f71463648b6009e and project a1af4242504b4c7fa0903c7c61b02135. Resources: {'ram', 'instances', 'cores'} {{(pid=117855) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 24 10:30:56.417977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Going to run 1 instances... {{(pid=117855) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 24 10:30:56.420146 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3a6fea2b-307e-4ae4-a632-91a71e989564',volume_size=None,volume_type=None)] {{(pid=117855) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 24 10:30:56.562646 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-90b0cc72-9241-4687-9258-165dfd541080 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.824509 Jun 24 10:30:56.563531 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 505/1009] 10.222.0.64 () {60 vars in 1146 bytes} [Fri Jun 24 10:30:55 2022] POST /compute/v2.1/servers => generated 405 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 24 10:30:56.576926 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:56.581504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:30:56.587418 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-396cf878-e39f-4b67-b759-c3fcdfdd6602 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:56.588046 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-396cf878-e39f-4b67-b759-c3fcdfdd6602 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:30:56.664457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-396cf878-e39f-4b67-b759-c3fcdfdd6602 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:30:56.671514 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-396cf878-e39f-4b67-b759-c3fcdfdd6602 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1094 microversion: 2.1 time: 0.097159 Jun 24 10:30:56.672167 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 505/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:30:56 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1094 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:30:57.689438 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:57.690179 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:30:57.697626 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:57.698061 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:57.698869 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:57.699421 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:57.770075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:30:57.778850 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ea2fef39-6445-4ee2-a3a0-f530e5aae753 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1210 microversion: 2.1 time: 0.093831 Jun 24 10:30:57.779463 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 506/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:30:57 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1210 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:30:58.797907 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:58.798642 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:30:58.808413 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:58.808591 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:58.809413 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:58.810579 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:58.964990 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:30:58.973542 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-7f0b21ff-b28c-4ac9-9e4e-6b7be2a13e00 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.179817 Jun 24 10:30:58.974439 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 506/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:30:58 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:30:59.067063 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-2d0c9a9d-e75c-4877-8217-9db1be3bace4 req-57f4fb42-182c-424e-b509-374b10bddd39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0859e9-f766-4509-a624-f2e44e9dfddf", "tag": "2ae9ed6f-e900-42d2-8cae-7761fc4e88e5"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:30:59.091120 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2d0c9a9d-e75c-4877-8217-9db1be3bace4 req-57f4fb42-182c-424e-b509-374b10bddd39 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:59.091546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-2d0c9a9d-e75c-4877-8217-9db1be3bace4 req-57f4fb42-182c-424e-b509-374b10bddd39 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:59.105065 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-2d0c9a9d-e75c-4877-8217-9db1be3bace4 req-57f4fb42-182c-424e-b509-374b10bddd39 service nova] Creating event network-changed:2ae9ed6f-e900-42d2-8cae-7761fc4e88e5 for instance 4b0859e9-f766-4509-a624-f2e44e9dfddf on hv-cinder-84713 Jun 24 10:30:59.110645 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-2d0c9a9d-e75c-4877-8217-9db1be3bace4 req-57f4fb42-182c-424e-b509-374b10bddd39 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047700 Jun 24 10:30:59.111277 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 507/1013] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:30:59.990834 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:30:59.991440 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:30:59.998345 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:30:59.998822 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:30:59.999618 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:00.000066 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:00.154605 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:00.163035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-ad867c78-269e-41a3-9272-4a3bd004a926 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.176217 Jun 24 10:31:00.163616 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 507/1014] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:30:59 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:01.182317 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:01.183044 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:01.191096 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:01.191644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:01.192431 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:01.192864 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:01.337983 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:01.347232 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-7a3a0661-fd0e-41a6-aff5-c00bd66f822a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.169741 Jun 24 10:31:01.348158 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 508/1015] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:01 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:02.365092 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:02.365760 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:02.373424 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:02.374136 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:02.375343 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:02.375970 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:02.527406 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:02.535274 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-5b00d656-8a7f-44d7-9a97-6c0277f81eca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.174118 Jun 24 10:31:02.536333 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 508/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:02 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:03.554174 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:03.554799 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:03.562220 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:03.562671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:03.563482 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:03.563921 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:03.705711 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:03.714223 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-195afe42-ac69-436f-b9bc-fcd8553be3b9 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.164860 Jun 24 10:31:03.714830 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 509/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:03 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:04.732320 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:04.732949 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:04.742910 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:04.743412 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:04.744548 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:04.745033 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:04.901145 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:04.910037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-3093f5e9-b2f4-45da-afe3-3ba953274ec3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.181356 Jun 24 10:31:04.910995 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 509/1018] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:04 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:05.927949 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:05.928667 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:05.936145 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:05.936598 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:05.937385 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:05.937841 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:06.085111 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:06.093273 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-12035b6f-69f5-4a65-ad07-70f17f45c29d tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.169821 Jun 24 10:31:06.093885 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 510/1019] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:05 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:07.110848 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:07.111483 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:07.114037 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell0:SELECT=2 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:31:07.119840 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:07.120293 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:07.121072 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:07.121504 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:07.261956 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:07.270757 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-87b95b8f-9ff9-4d14-a246-2d0fdec9d78e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.163752 Jun 24 10:31:07.271253 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 510/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:07 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:08.290036 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:08.290657 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:08.292807 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=2 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:31:08.293477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell0:SELECT=6 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:31:08.299828 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:08.300279 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:08.301112 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:08.301620 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:08.459951 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:08.468071 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-be97586a-f608-4a04-8b6e-b62df56021e6 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.182349 Jun 24 10:31:08.468644 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 511/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:08 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:09.487266 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:09.488170 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:09.495631 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:09.496087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:09.496857 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:09.497297 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:09.551173 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [req-b9409014-e6d3-4993-88f4-8c055d755691 req-cfefadfc-b1a5-4295-b6c3-6c6859d1ea85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0859e9-f766-4509-a624-f2e44e9dfddf", "name": "network-vif-plugged", "status": "completed", "tag": "2ae9ed6f-e900-42d2-8cae-7761fc4e88e5"}]} {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:31:09.561185 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-b9409014-e6d3-4993-88f4-8c055d755691 req-cfefadfc-b1a5-4295-b6c3-6c6859d1ea85 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:09.561669 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [req-b9409014-e6d3-4993-88f4-8c055d755691 req-cfefadfc-b1a5-4295-b6c3-6c6859d1ea85 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:09.574309 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.compute.server_external_events [req-b9409014-e6d3-4993-88f4-8c055d755691 req-cfefadfc-b1a5-4295-b6c3-6c6859d1ea85 service nova] Creating event network-vif-plugged:2ae9ed6f-e900-42d2-8cae-7761fc4e88e5 for instance 4b0859e9-f766-4509-a624-f2e44e9dfddf on hv-cinder-84713 Jun 24 10:31:09.579935 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [req-b9409014-e6d3-4993-88f4-8c055d755691 req-cfefadfc-b1a5-4295-b6c3-6c6859d1ea85 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032849 Jun 24 10:31:09.580560 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 512/1022] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:31:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:31:09.646503 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:09.654152 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b242f72a-598f-4395-84ce-efde3564a177 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.172160 Jun 24 10:31:09.654768 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 511/1023] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:09 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:10.672095 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:10.672854 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:10.680019 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:10.680477 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:10.681255 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:10.681683 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:10.833725 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:10.841966 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-d1ceca07-49bf-4e8f-b06c-32b204247f7e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1265 microversion: 2.1 time: 0.174670 Jun 24 10:31:10.842548 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 513/1024] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:10 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:11.860093 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:11.860725 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:11.867992 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:11.868455 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:11.869225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:11.869722 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:12.024831 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:12.035662 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-f94254bd-7749-4b05-8427-cc8f94dc712a tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1452 microversion: 2.1 time: 0.180742 Jun 24 10:31:12.036362 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 512/1025] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:11 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1452 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 24 10:31:12.053234 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:31:12.053843 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:31:12.060941 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:12.061388 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:12.062161 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:12.062592 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:12.215055 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:31:12.226454 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0a4acdf7-fac1-4c8c-ad34-bb1437efde24 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1452 microversion: 2.1 time: 0.177178 Jun 24 10:31:12.227103 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 514/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:31:12 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1452 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:31:14.249450 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-6570a27c-30f2-4cbd-8bb1-f7119a34f0e4 req-63f07514-03f6-4275-ab39-7c813f5d8ee6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0859e9-f766-4509-a624-f2e44e9dfddf", "tag": "2ae9ed6f-e900-42d2-8cae-7761fc4e88e5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:31:14.259694 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-6570a27c-30f2-4cbd-8bb1-f7119a34f0e4 req-63f07514-03f6-4275-ab39-7c813f5d8ee6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:31:14.260035 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-6570a27c-30f2-4cbd-8bb1-f7119a34f0e4 req-63f07514-03f6-4275-ab39-7c813f5d8ee6 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:31:14.272721 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-6570a27c-30f2-4cbd-8bb1-f7119a34f0e4 req-63f07514-03f6-4275-ab39-7c813f5d8ee6 service nova] Creating event network-changed:2ae9ed6f-e900-42d2-8cae-7761fc4e88e5 for instance 4b0859e9-f766-4509-a624-f2e44e9dfddf on hv-cinder-84713 Jun 24 10:31:14.278237 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-6570a27c-30f2-4cbd-8bb1-f7119a34f0e4 req-63f07514-03f6-4275-ab39-7c813f5d8ee6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032294 Jun 24 10:31:14.279419 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 513/1027] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:31:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:31:30.829719 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:31:30.830333 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Fri Jun 24 10:31:30 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:31:31.005768 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:31:31.006341 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:31:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:32:36.783533 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:36.784865 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG dbcounter [-] [117855] Writing DB stats nova_cell1:SELECT=48 {{(pid=117855) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:36.786237 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_api:SELECT=20 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:36.787210 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG dbcounter [-] [117854] Writing DB stats nova_cell1:SELECT=44 {{(pid=117854) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 24 10:32:36.788576 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:36.789137 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:36.808288 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:36.808738 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:36.809652 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:36.810092 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:36.854793 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:32:36.860587 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-2a788181-6e6a-40d6-bc09-9475088f2dbf req-a938fc80-3489-4691-bd03-e5e030f192b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b0859e9-f766-4509-a624-f2e44e9dfddf", "tag": "2ae9ed6f-e900-42d2-8cae-7761fc4e88e5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:32:36.874457 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-2a788181-6e6a-40d6-bc09-9475088f2dbf req-a938fc80-3489-4691-bd03-e5e030f192b3 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:36.874929 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-2a788181-6e6a-40d6-bc09-9475088f2dbf req-a938fc80-3489-4691-bd03-e5e030f192b3 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:36.888384 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-2a788181-6e6a-40d6-bc09-9475088f2dbf req-a938fc80-3489-4691-bd03-e5e030f192b3 service nova] Creating event network-changed:2ae9ed6f-e900-42d2-8cae-7761fc4e88e5 for instance 4b0859e9-f766-4509-a624-f2e44e9dfddf on hv-cinder-84713 Jun 24 10:32:36.895116 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-2a788181-6e6a-40d6-bc09-9475088f2dbf req-a938fc80-3489-4691-bd03-e5e030f192b3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109735 Jun 24 10:32:36.896150 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 514/1028] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:32:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:32:36.956700 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-4f16584b-2329-4a68-8ce4-e3ceca9080f7 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 204 len: 0 microversion: 2.1 time: 0.174056 Jun 24 10:32:36.957776 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 515/1029] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:32:36 2022] DELETE /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 24 10:32:36.968059 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:36.968747 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:36.975721 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:36.976365 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:36.977767 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:36.978286 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:37.198219 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:32:37.207808 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-dfba6d98-bc6d-40b0-9e55-d5e6ded9642f tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1577 microversion: 2.1 time: 0.245248 Jun 24 10:32:37.208638 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 515/1030] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:36 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1577 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:32:38.234673 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:38.235374 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:38.242233 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:38.242670 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:38.243550 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:38.243944 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:38.441227 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:32:38.449842 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-0308e513-670d-42f9-9f95-efcc8c26561e tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1577 microversion: 2.1 time: 0.219551 Jun 24 10:32:38.450430 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 516/1031] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:38 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:32:39.048160 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-1fcbf18c-b39d-4286-b154-2cfc46ae3eb6 req-9914a814-0179-491e-88b9-08b40b158fd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b0859e9-f766-4509-a624-f2e44e9dfddf", "name": "network-vif-deleted", "tag": "2ae9ed6f-e900-42d2-8cae-7761fc4e88e5"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:32:39.063706 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-1fcbf18c-b39d-4286-b154-2cfc46ae3eb6 req-9914a814-0179-491e-88b9-08b40b158fd2 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:39.064244 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-1fcbf18c-b39d-4286-b154-2cfc46ae3eb6 req-9914a814-0179-491e-88b9-08b40b158fd2 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:39.079346 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-1fcbf18c-b39d-4286-b154-2cfc46ae3eb6 req-9914a814-0179-491e-88b9-08b40b158fd2 service nova] Creating event network-vif-deleted:2ae9ed6f-e900-42d2-8cae-7761fc4e88e5 for instance 4b0859e9-f766-4509-a624-f2e44e9dfddf on hv-cinder-84713 Jun 24 10:32:39.085696 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-1fcbf18c-b39d-4286-b154-2cfc46ae3eb6 req-9914a814-0179-491e-88b9-08b40b158fd2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043698 Jun 24 10:32:39.086275 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 516/1032] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:32:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 24 10:32:39.468137 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:39.468671 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:39.475421 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:39.475870 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:39.476640 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:39.477075 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:39.508347 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:39.508796 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:39.509509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lazy-loading 'fault' on Instance uuid 4b0859e9-f766-4509-a624-f2e44e9dfddf {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:32:39.557163 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:32:39.565168 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-2e88bfc3-f9ca-4d29-9032-d8732fff67ec tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 200 len: 1230 microversion: 2.1 time: 0.101131 Jun 24 10:32:39.565695 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 517/1033] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:39 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 1230 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:32:40.592918 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:40.594090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: 4b0859e9-f766-4509-a624-f2e44e9dfddf] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:40.606497 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:40.606988 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:40.607811 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:40.608193 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:40.624526 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] HTTP exception thrown: Instance 4b0859e9-f766-4509-a624-f2e44e9dfddf could not be found. Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Request method failure captured: Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf HTTP/1.1 Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZFQN9CJq6oxIEGzPsSsEHRgOyMKF-dtBIg6PZHLbdWQ-wmC2MzgfHUoC2cVSINOoT6F0MnbvZm70xIbRGuBxdEiA5H5DvfRqrR1d1HxBewjUK_-3DDVHmYHmXh47b0NFqy0cOvRfPlY01x-H5poqI-lWoJU0p17E3RkRKXhOgtKN6c Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:32:40.626169 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a1af4242504b4c7fa0903c7c61b02135", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}] Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 5855c9996e4345aa8f71463648b6009e Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance 4b0859e9-f766-4509-a624-f2e44e9dfddf could not be found. Jun 24 10:32:40.627953 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': '4b0859e9-f766-4509-a624-f2e44e9dfddf'} Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b0859e9-f766-4509-a624-f2e44e9dfddf could not be found. Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:32:40.628989 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b0859e9-f766-4509-a624-f2e44e9dfddf could not be found. Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b0859e9-f766-4509-a624-f2e44e9dfddf could not be found. Jun 24 10:32:40.630586 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:40.632314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Returning 404 to user: Instance 4b0859e9-f766-4509-a624-f2e44e9dfddf could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:32:40.632314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-332d7b5b-65a7-47f3-be24-c62cc85bbb96 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf" status: 404 len: 111 microversion: 2.1 time: 0.045347 Jun 24 10:32:40.632314 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 517/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:40 2022] GET /compute/v2.1/servers/4b0859e9-f766-4509-a624-f2e44e9dfddf => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:32:43.964213 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:43.964838 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:43.967041 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-2f06ff0b-2d59-4b13-a310-1bc33a1bd2d9 req-aba56a49-fdc9-45e8-ab01-4c0b6e750293 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3a026c-235f-4a5d-bf09-ae6e1c13f888", "tag": "1b531ede-6da7-4696-9e82-2fe054e3a392"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:32:43.972440 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:43.973057 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:43.973926 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:43.974473 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:43.976480 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-2f06ff0b-2d59-4b13-a310-1bc33a1bd2d9 req-aba56a49-fdc9-45e8-ab01-4c0b6e750293 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:43.976901 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-2f06ff0b-2d59-4b13-a310-1bc33a1bd2d9 req-aba56a49-fdc9-45e8-ab01-4c0b6e750293 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:43.990347 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-2f06ff0b-2d59-4b13-a310-1bc33a1bd2d9 req-aba56a49-fdc9-45e8-ab01-4c0b6e750293 service nova] Creating event network-changed:1b531ede-6da7-4696-9e82-2fe054e3a392 for instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 on hv-cinder-84713 Jun 24 10:32:43.996429 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-2f06ff0b-2d59-4b13-a310-1bc33a1bd2d9 req-aba56a49-fdc9-45e8-ab01-4c0b6e750293 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033201 Jun 24 10:32:43.998886 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 518/1035] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:32:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:32:44.007913 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Going to try to terminate instance {{(pid=117855) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 24 10:32:44.108610 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-f72f1f74-31b7-4540-b93c-999c7192b606 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "DELETE /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 204 len: 0 microversion: 2.1 time: 0.148344 Jun 24 10:32:44.110131 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 518/1036] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:32:43 2022] DELETE /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 24 10:32:44.124034 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:44.125342 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:44.133097 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:44.133999 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:44.134853 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:44.135458 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:44.272896 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.policy [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117854) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:32:44.281693 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-47c83ec4-4060-4aa0-a891-ba1063161535 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1576 microversion: 2.1 time: 0.166535 Jun 24 10:32:44.282281 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 519/1037] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:44 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:32:45.299963 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:45.300750 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:45.307896 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:45.308342 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:45.309155 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:45.309597 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:45.456977 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:32:45.468509 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-075355be-d767-4cb1-9f4c-195f5e38a87b tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1576 microversion: 2.1 time: 0.172870 Jun 24 10:32:45.469584 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 519/1038] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:45 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:32:46.246246 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [req-ec1ef63d-8424-42f9-b8a1-7bc159f126ba req-c42e2343-5e4f-48b9-8f07-af41bcd290a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3a026c-235f-4a5d-bf09-ae6e1c13f888", "name": "network-vif-deleted", "tag": "1b531ede-6da7-4696-9e82-2fe054e3a392"}]} {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 24 10:32:46.255958 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-ec1ef63d-8424-42f9-b8a1-7bc159f126ba req-c42e2343-5e4f-48b9-8f07-af41bcd290a4 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:46.256396 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [req-ec1ef63d-8424-42f9-b8a1-7bc159f126ba req-c42e2343-5e4f-48b9-8f07-af41bcd290a4 service nova] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:46.269854 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.compute.server_external_events [req-ec1ef63d-8424-42f9-b8a1-7bc159f126ba req-c42e2343-5e4f-48b9-8f07-af41bcd290a4 service nova] Creating event network-vif-deleted:1b531ede-6da7-4696-9e82-2fe054e3a392 for instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 on hv-cinder-84713 Jun 24 10:32:46.275084 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [req-ec1ef63d-8424-42f9-b8a1-7bc159f126ba req-c42e2343-5e4f-48b9-8f07-af41bcd290a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032326 Jun 24 10:32:46.275659 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 520/1039] 10.222.0.64 () {64 vars in 1317 bytes} [Fri Jun 24 10:32:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 24 10:32:46.486795 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:46.487681 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:46.494580 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:46.495069 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:46.495856 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:46.496285 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:46.538613 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:46.539176 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:46.539622 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.objects.instance [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lazy-loading 'fault' on Instance uuid df3a026c-235f-4a5d-bf09-ae6e1c13f888 {{(pid=117855) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 24 10:32:46.588240 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.policy [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5855c9996e4345aa8f71463648b6009e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1af4242504b4c7fa0903c7c61b02135', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117855) authorize /opt/stack/nova/nova/policy.py:199}} Jun 24 10:32:46.596466 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-ad5c0d03-c6b1-4a19-8589-fbb85c8cb241 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 200 len: 1230 microversion: 2.1 time: 0.114211 Jun 24 10:32:46.597285 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 520/1040] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:46 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 1230 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 24 10:32:47.614824 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:47.615520 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: df3a026c-235f-4a5d-bf09-ae6e1c13f888] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:47.622309 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:47.622748 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:47.623537 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:47.623974 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:47.637772 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] HTTP exception thrown: Instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 could not be found. Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Request method failure captured: Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 HTTP/1.1 Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZFQN9CJq6oxIEGzPsSsEHRgOyMKF-dtBIg6PZHLbdWQ-wmC2MzgfHUoC2cVSINOoT6F0MnbvZm70xIbRGuBxdEiA5H5DvfRqrR1d1HxBewjUK_-3DDVHmYHmXh47b0NFqy0cOvRfPlY01x-H5poqI-lWoJU0p17E3RkRKXhOgtKN6c Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:32:47.639490 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a1af4242504b4c7fa0903c7c61b02135", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}] Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 5855c9996e4345aa8f71463648b6009e Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 could not be found. Jun 24 10:32:47.641966 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'df3a026c-235f-4a5d-bf09-ae6e1c13f888'} Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 could not be found. Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:32:47.642856 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 could not be found. Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 could not be found. Jun 24 10:32:47.644259 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:47.645613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Returning 404 to user: Instance df3a026c-235f-4a5d-bf09-ae6e1c13f888 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:32:47.645613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-bfeb634c-f85d-4d2e-8a64-5e084d4471ca tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888" status: 404 len: 111 microversion: 2.1 time: 0.031182 Jun 24 10:32:47.645613 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 521/1041] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:47 2022] GET /compute/v2.1/servers/df3a026c-235f-4a5d-bf09-ae6e1c13f888 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:32:48.094074 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:48.094870 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.compute.api [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117855) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:48.101457 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:48.101908 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:48.102676 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:48.103148 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG oslo_concurrency.lockutils [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117855) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:48.116730 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.wsgi [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] HTTP exception thrown: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Request method failure captured: Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: request: DELETE /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 HTTP/1.1 Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept: application/json Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Accept-Encoding: identity Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Connection: close Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Length: 0 Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Content-Type: application/json Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Host: 10.222.0.64 Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Openstack-System-Scope: None Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: User-Agent: python-urllib3/1.26.9 Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Auth-Token: gAAAAABitZFQN9CJq6oxIEGzPsSsEHRgOyMKF-dtBIg6PZHLbdWQ-wmC2MzgfHUoC2cVSINOoT6F0MnbvZm70xIbRGuBxdEiA5H5DvfRqrR1d1HxBewjUK_-3DDVHmYHmXh47b0NFqy0cOvRfPlY01x-H5poqI-lWoJU0p17E3RkRKXhOgtKN6c Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Id: None Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Domain-Name: None Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Identity-Status: Confirmed Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Is-Admin-Project: True Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Id: default Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Domain-Name: Default Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Project-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Role: member,reader Jun 24 10:32:48.118456 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Roles: member,reader Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a1af4242504b4c7fa0903c7c61b02135", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}] Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Id: default Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Domain-Name: Default Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Id: 5855c9996e4345aa8f71463648b6009e Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: X-User-Name: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: method: > Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: exception: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.120212 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: action_args: {'id': 'a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73'} Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:32:48.121050 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.122371 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.123731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Returning 404 to user: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. {{(pid=117855) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:32:48.123731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-bcdc0dab-b423-4cb2-9524-018cb2f382f8 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "DELETE /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 404 len: 111 microversion: 2.1 time: 0.029934 Jun 24 10:32:48.123731 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 521/1042] 10.222.0.64 () {58 vars in 1238 bytes} [Fri Jun 24 10:32:48 2022] DELETE /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:32:48.129538 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '>' {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:48.130151 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.compute.api [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] [instance: a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73] Fetching instance by UUID {{(pid=117854) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 24 10:32:48.136445 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:48.136895 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:48.137658 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 24 10:32:48.138090 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG oslo_concurrency.lockutils [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Lock "5c7d15be-2aaf-4832-94f4-0ad39b6d90ec" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117854) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 24 10:32:48.152194 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.wsgi [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] HTTP exception thrown: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Request method failure captured: Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: request: GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 HTTP/1.1 Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept: application/json Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Accept-Encoding: identity Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Connection: close Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Length: 0 Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Content-Type: application/json Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Host: 10.222.0.64 Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Openstack-System-Scope: None Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: User-Agent: python-urllib3/1.26.9 Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Auth-Token: gAAAAABitZFQN9CJq6oxIEGzPsSsEHRgOyMKF-dtBIg6PZHLbdWQ-wmC2MzgfHUoC2cVSINOoT6F0MnbvZm70xIbRGuBxdEiA5H5DvfRqrR1d1HxBewjUK_-3DDVHmYHmXh47b0NFqy0cOvRfPlY01x-H5poqI-lWoJU0p17E3RkRKXhOgtKN6c Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Id: None Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Domain-Name: None Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Identity-Status: Confirmed Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Is-Admin-Project: True Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Id: default Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Domain-Name: Default Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Project-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Role: member,reader Jun 24 10:32:48.153726 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Roles: member,reader Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a1af4242504b4c7fa0903c7c61b02135", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a1af4242504b4c7fa0903c7c61b02135"}]}] Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Id: a1af4242504b4c7fa0903c7c61b02135 Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-Tenant-Name: tempest-TestVolumeBootPattern-1695940306 Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Id: default Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Domain-Name: Default Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Id: 5855c9996e4345aa8f71463648b6009e Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: X-User-Name: tempest-TestVolumeBootPattern-1695940306-project Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: method: > Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: exception: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.155547 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: action_args: {'id': 'a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73'} Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: {{(pid=117854) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 24 10:32:48.156804 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. Jun 24 10:32:48.158225 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: ERROR nova.api.openstack.wsgi Jun 24 10:32:48.160087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: DEBUG nova.api.openstack.wsgi [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Returning 404 to user: Instance a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 could not be found. {{(pid=117854) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 24 10:32:48.160087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO nova.api.openstack.requestlog [None req-b0d2e598-d1f6-4264-961b-415ed0b9ece3 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73" status: 404 len: 111 microversion: 2.1 time: 0.029723 Jun 24 10:32:48.160087 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: [pid: 117854|app: 0|req: 522/1043] 10.222.0.64 () {58 vars in 1235 bytes} [Fri Jun 24 10:32:48 2022] GET /compute/v2.1/servers/a8e2431c-44c0-4ec6-9a02-f9cf7ff94d73 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 24 10:32:49.463729 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: DEBUG nova.api.openstack.wsgi [None req-00d109ab-741e-4d13-a7c7-f18f4d490fe1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] Calling method '.version_select at 0x7f3774b688b0>' {{(pid=117855) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 24 10:32:49.487318 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO nova.api.openstack.requestlog [None req-00d109ab-741e-4d13-a7c7-f18f4d490fe1 tempest-TestVolumeBootPattern-1695940306 tempest-TestVolumeBootPattern-1695940306-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-197236867" status: 202 len: 0 microversion: 2.1 time: 0.027474 Jun 24 10:32:49.488342 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: [pid: 117855|app: 0|req: 522/1044] 10.222.0.64 () {58 vars in 1259 bytes} [Fri Jun 24 10:32:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-197236867 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 24 10:32:57.251899 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:32:57.252402 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:32:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:34:51.014825 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:34:51.015572 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:34:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:36:17.293876 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:36:17.294684 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:36:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:36:26.204728 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:36:26.205546 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Fri Jun 24 10:36:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:38:10.843635 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:38:10.844390 dv-cinder-847132-2-iscsi devstack@n-api.service[117855]: Fri Jun 24 10:38:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 24 10:38:11.024088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 24 10:38:11.024088 dv-cinder-847132-2-iscsi devstack@n-api.service[117854]: Fri Jun 24 10:38:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!